-- Logs begin at Mon 2022-08-01 21:41:53 UTC, end at Mon 2022-08-01 23:05:06 UTC. -- Aug 01 22:34:02.746680 dv-cinder-851640-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 22:34:02.755504 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 22:34:02 2022] *** Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: nodename: dv-cinder-851640-1-iscsi Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: machine: x86_64 Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: clock source: unix Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: pcre jit disabled Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: detected number of CPU cores: 4 Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: current working directory: / Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: detected binary path: /usr/bin/uwsgi-core Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: your processes number limit is 47680 Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: your memory page size is 4096 bytes Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: detected max file descriptor number: 2048 Aug 01 22:34:02.757529 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: lock engine: pthread robust mutexes Aug 01 22:34:02.758642 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: thunder lock: enabled Aug 01 22:34:02.758642 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 22:34:02.758642 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 22:34:02.796371 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: Python main interpreter initialized at 0x55d453ea19c0 Aug 01 22:34:02.796371 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: python threads support enabled Aug 01 22:34:02.796371 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: your server socket listen backlog is limited to 100 connections Aug 01 22:34:02.796371 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: your mercy for graceful operations on workers is 90 seconds Aug 01 22:34:02.796729 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 22:34:02.796729 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: *** Operational MODE: preforking *** Aug 01 22:34:02.797032 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: *** uWSGI is running in multiple interpreter mode *** Aug 01 22:34:02.797032 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: spawned uWSGI master process (pid: 109843) Aug 01 22:34:02.797228 dv-cinder-851640-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 22:34:02.798061 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: spawned uWSGI worker 1 (pid: 109844, cores: 1) Aug 01 22:34:02.798182 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: spawned uWSGI worker 2 (pid: 109845, cores: 1) Aug 01 22:34:02.798251 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 22:34:03.448741 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 22:34:03.450329 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 22:34:04.521116 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:34:04.521116 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: from cryptography.utils import int_from_bytes Aug 01 22:34:04.521879 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:34:04.521879 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: from cryptography.utils import int_from_bytes Aug 01 22:34:04.522053 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:34:04.522053 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: from cryptography.utils import int_from_bytes Aug 01 22:34:04.522053 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:34:04.522053 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: from cryptography.utils import int_from_bytes Aug 01 22:34:06.979427 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 22:34:06.980148 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 22:34:06.980513 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 22:34:06.980607 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 22:34:06.980676 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 22:34:06.980741 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 22:34:06.980805 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 22:34:06.980878 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 22:34:06.980944 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 22:34:06.981009 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 22:34:06.981144 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.981293 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.981436 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.981690 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.981828 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.981925 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.982066 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.982263 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.982412 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.982590 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.982717 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.982871 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.982971 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.983216 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.983347 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.983508 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.983625 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.983856 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.983986 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.984089 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.984171 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.984412 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.984555 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-1-iscsi {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.984732 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-1-iscsi {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.984876 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.985050 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.985196 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.985330 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.985428 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.985685 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.985841 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.985959 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.986059 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.986270 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.986378 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.986593 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.986769 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.986913 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.987086 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.987369 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.987497 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.987674 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.987811 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.987973 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.988115 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.988279 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.988445 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.988610 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.988741 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.988920 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.989053 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.989222 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.989375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.989533 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.989694 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.989863 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.989998 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.990165 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.990294 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.990477 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.990687 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-1-iscsi {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.990870 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-1-iscsi {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.990998 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.991182 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.991304 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.991489 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.991660 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.991867 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.992034 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.992289 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.992386 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.992599 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.992696 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.992908 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.992994 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.993225 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.993323 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.993532 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.993654 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.993886 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.993974 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.994201 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.994296 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.994516 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.994613 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.994831 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.994917 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.995132 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.995217 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.995432 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.995518 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.995734 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.995831 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.996037 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.996125 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.996339 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.996480 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.996636 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.996736 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.996885 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.997025 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.997167 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.997252 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.997472 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.997591 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.997814 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.997908 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.998129 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.998275 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.998547 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.998644 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.998834 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.998990 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:06.999115 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.001966 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002098 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002176 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002176 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002297 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002362 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002434 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002508 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002508 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002639 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002710 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002710 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002837 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002903 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.002903 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003017 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003087 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003087 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003215 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003287 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003287 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003403 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003755 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003852 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.003930 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.004164 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.004361 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.004452 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.004791 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.004941 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.005217 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.005346 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.005540 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.005652 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.005890 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.006068 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.006221 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.006311 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.006542 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.006646 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.006881 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.007087 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.007269 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.007522 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.007613 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.007691 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.007873 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.008046 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.008222 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.008386 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.008534 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.008665 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.008803 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.009020 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.009234 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.009433 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.009666 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.009863 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.010048 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.010443 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.010614 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.010770 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.010941 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011082 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011199 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011304 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011407 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011407 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011612 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011716 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011838 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.011942 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012043 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012172 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012298 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012430 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012560 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012689 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012809 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.012934 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.013061 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.013181 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.013316 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.013444 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.013599 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.013760 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.013961 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.014160 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.014305 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.014433 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.014563 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.014692 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015310 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015451 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015535 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015616 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015697 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015764 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015849 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.015960 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016053 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016161 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016321 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016471 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016639 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016769 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016898 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.016994 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.017228 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.017377 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.017623 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.017728 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.017811 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.017889 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.018144 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.018278 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.018462 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.018608 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.018736 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.018841 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.019062 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.019196 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.019376 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.019521 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.019651 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.019755 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.019971 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.020102 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.020311 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.020455 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.020544 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.020623 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.020828 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.020939 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.021147 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.021278 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.021454 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.021612 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.021742 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.021859 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.022065 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.022212 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.022340 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.022436 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.022659 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.022813 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.022912 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.023009 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.023269 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.023403 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.023556 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.023667 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.023849 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.023940 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.024150 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.024241 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.024461 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.024565 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.024768 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.024868 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.025065 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.025156 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.025364 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.025455 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.025700 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:34:07.025793 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.026040 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.026145 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.026367 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.026465 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.026681 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.026770 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.026997 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.027090 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.027305 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.027393 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.027611 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.027710 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.027922 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.028026 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.028231 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.028323 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.028542 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.028632 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.028864 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.028963 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.029168 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.029258 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.029474 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.029607 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.029799 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.029895 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.030110 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.030207 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.030423 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.030553 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.030748 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.030860 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.031065 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.031166 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.031370 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.031464 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.031682 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.031777 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.031992 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.032080 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.032308 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.032396 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.032632 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.032733 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.032948 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.033035 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.033253 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.033343 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.033579 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.033683 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.033893 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.033981 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.034219 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.034320 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.034546 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.034632 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.034858 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.034942 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.035161 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.035246 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.035466 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.035553 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.035774 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.035868 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.036085 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.036173 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.036396 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.036491 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.036702 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.036788 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.037015 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.037110 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.037322 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.037410 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.037659 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.037749 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.037968 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.038067 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.038273 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.038360 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.038578 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.038698 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.038938 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.039040 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.039247 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.039334 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.039552 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.039638 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.039854 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.040026 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.040158 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.040246 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.040468 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.040561 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.040775 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.040873 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.041150 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.041248 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.041383 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.041470 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.041707 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.041797 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.042010 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.042106 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.042316 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.042403 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.042618 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.042713 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.042923 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.043008 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.043231 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.043317 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.043536 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.043623 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.043845 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.043941 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.044152 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.044237 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.044455 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.044541 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.044760 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.044847 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.045070 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.045168 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.045374 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.045469 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.045719 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.045870 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.046024 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.046180 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.046329 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.046482 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.046641 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.046802 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.046955 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.047100 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.047398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.047560 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.047699 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.047827 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.047998 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.048144 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.048298 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.048436 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.048597 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.048744 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.048902 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.049047 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.049260 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.049405 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.049631 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.049796 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.049952 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.050102 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.050241 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.050365 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.050515 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.050670 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.050900 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.051063 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.051237 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.051394 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.051537 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.051677 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.051833 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.051974 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.052116 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.052253 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.052375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.052516 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.052649 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.052776 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.052899 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.053027 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.053165 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.053290 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.053403 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.053583 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.053716 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.053925 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.054059 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.054289 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.054444 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.054580 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.054702 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.054878 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.055033 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.055183 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.055322 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.055449 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.055571 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.055756 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.055946 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.056081 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.056297 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.056431 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.056647 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.056782 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.056928 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.057058 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.057261 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.057417 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.057585 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.057739 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.057891 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.058043 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.058183 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.058317 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.058517 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.058658 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.058802 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.058992 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.059129 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.059332 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.059456 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.059709 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.059798 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.060015 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.060101 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.060322 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.060408 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.060628 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.060716 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.060934 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.061027 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.061252 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.061345 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.061619 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.061713 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.061896 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.061983 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.062204 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.062304 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.062524 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.062617 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.062831 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.062922 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.063145 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.063232 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.063445 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.063540 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.063756 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.063843 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.064091 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.064184 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.064402 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.064489 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.064712 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.064809 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.065019 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.065113 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.065320 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.065407 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.065655 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.065760 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.065959 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.066054 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.066266 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.066352 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.066571 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.066665 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.066877 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.066973 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.067184 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.067309 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.067488 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.067574 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.067801 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.067888 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.068105 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.068190 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.068405 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.068490 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.068716 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.068806 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.069030 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.069116 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.069331 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.069417 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.069662 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.069753 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.070007 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.070092 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.070328 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.070414 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.070633 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.070720 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.070945 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.071040 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.071253 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.071347 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.071557 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.071642 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.071859 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.071951 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.072163 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.072257 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.072467 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.072554 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.072767 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.072854 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.073074 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.073168 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.073377 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.073463 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.073740 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.073869 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.074015 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.074119 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.074315 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.074406 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.074613 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.074707 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.074921 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.075007 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.075222 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.075308 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.075522 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.075609 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.075836 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.075923 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.076153 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.076239 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.076455 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.076540 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.076760 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.076847 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.077076 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.077161 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.077379 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.077465 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.077702 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.077791 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078004 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078089 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078309 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078395 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078608 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078738 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078908 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.078995 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.079208 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.079303 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.079525 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.079610 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.079839 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.079927 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.080142 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.080238 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.080451 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.080542 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.080765 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.080864 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.081072 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.081166 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.081381 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.081467 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.081711 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.081801 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.082020 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.082117 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.082328 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.082413 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.082636 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.082728 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.082944 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.083034 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.083249 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.083333 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.083555 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.083641 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.083864 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.083950 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.084170 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.084255 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.084476 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.084561 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.084780 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.084868 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.085084 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.085169 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.085392 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.085477 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.085769 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.086047 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.086134 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.086380 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.086474 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.086701 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.086951 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.087044 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.087281 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.087367 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.087592 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.087692 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.087909 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.087995 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.088225 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.088312 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.088539 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.088637 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.088871 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.088975 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.089191 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.089277 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.089508 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.089619 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.089840 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.089948 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.090149 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.090248 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.090454 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.090541 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.090756 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.090857 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.091058 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.091143 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.091359 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.091452 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.091699 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.091803 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.091957 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.092043 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.092257 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.092350 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.092553 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.092718 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.092855 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.092943 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.093155 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.093239 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.093452 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.093537 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.093779 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.093867 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.094081 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.094175 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.094387 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.094475 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.094689 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.094774 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.094991 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.095078 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.095296 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.095382 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.095601 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.095687 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.095903 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.096001 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.096203 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.096308 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.096542 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.096991 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.097201 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.097301 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.097532 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.097700 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.097858 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.097945 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.098187 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.098284 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.098491 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.098578 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.098790 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.098911 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.099091 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.099186 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.099397 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.099482 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.099698 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.099797 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.099996 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.100084 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.100302 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.100395 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.100607 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.100694 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.100907 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.101001 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.101238 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.101370 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.101539 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.101643 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.101869 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.101978 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.102171 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.102257 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.102465 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.102552 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.102770 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.102858 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.103077 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.103176 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.103380 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.103482 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.103685 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.103773 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.103983 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.104077 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.104283 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.104382 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.104588 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.104674 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.104887 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.104972 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.105184 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.105282 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.105488 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.105603 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.105812 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.105898 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.106112 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.106215 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.106414 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.106500 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.106714 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.106801 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.107013 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.107107 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.107317 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.107403 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.107625 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.107711 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.107924 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.108012 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.108223 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.108316 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.108530 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.108616 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.108830 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.108916 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.109128 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.109214 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.109431 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.109517 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.109772 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.109862 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.110071 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.110157 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.110375 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.110477 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.110689 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.110847 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.110994 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.111084 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.111291 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.111420 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.111593 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.111678 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.111964 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.112062 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.112190 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.112291 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.112489 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.112584 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.112788 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.112875 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.113086 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.113180 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.113385 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.113486 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.113707 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.113808 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.114008 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.114097 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.114309 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.114404 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.114609 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.114703 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.114914 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.115001 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.115211 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.115296 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.115512 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.115598 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.115814 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.115901 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.116154 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.116241 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.116455 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.116548 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.116830 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.116918 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.117145 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.117232 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.117456 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.117542 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.117794 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.117882 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.118099 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.118187 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.118404 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.118498 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.118713 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.118799 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.119010 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.119103 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.119319 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.119413 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.119621 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.119753 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.119928 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.120021 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.120227 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.120324 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.120529 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.120616 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.120846 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.120940 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.121154 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.121317 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.121460 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.121573 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.121793 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.121880 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.122105 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.122210 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.122415 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.122502 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.122711 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.122797 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.123019 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.123106 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.123325 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.123413 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.123629 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.123723 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.123933 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.124021 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.124235 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.124334 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.124543 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.124635 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.124848 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.124936 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.125155 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.125240 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.125460 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.125573 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.125791 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.125877 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.126091 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.126177 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.126395 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.126494 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.126698 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.126786 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.127000 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.127089 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.127309 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.127405 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.127614 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.127699 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.127913 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.128006 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.128215 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.128309 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.128510 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.128643 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.128816 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.128955 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.129115 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.129266 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.129536 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.129677 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.129865 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.129959 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.130170 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.130258 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.130472 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.130566 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.130775 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.130861 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.131081 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.131168 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.131392 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.131485 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.131703 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.131806 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.132002 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.132133 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.132418 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.132517 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.132728 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.132829 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.133033 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.133119 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.133338 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.133423 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.133659 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.133764 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.133958 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.134045 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.134263 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.134349 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.134567 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.134662 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.134869 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.134955 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.135167 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.135253 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.135466 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.135565 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.135786 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.135895 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.136085 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.136210 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.136398 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.136519 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.136806 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.136937 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.137110 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.137252 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.137412 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.137589 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.137849 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.137936 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.138157 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.138252 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.138462 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.138557 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.138781 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.138875 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.139096 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.139182 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.139415 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.139513 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.139717 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.139805 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.140027 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.140121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.140331 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.140419 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.140650 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.140736 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.140956 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.141049 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.141259 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.141345 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.141588 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.141679 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.141921 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.142007 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.142247 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.142342 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.142567 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.142652 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.142874 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.142968 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.143190 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.143286 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.143571 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.143656 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.143897 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.143984 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.144200 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.144295 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.144502 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.144587 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.144813 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.144899 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.145112 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.145205 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.145410 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.145499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.145748 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.145835 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.146051 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.146145 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.146364 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.146450 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.146675 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.146761 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.146984 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.147072 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.147288 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.147375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.147590 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.147676 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.147891 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.148033 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.148242 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.148332 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.148543 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.148640 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.148861 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.148947 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.149159 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.149245 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.149478 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.149637 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.149805 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.149892 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.150121 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.150213 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.150428 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.150523 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.150727 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.150813 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.151028 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.151113 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.151334 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.151433 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.151632 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.151720 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.151933 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.152024 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.152232 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.152324 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.152569 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.152659 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.152873 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.152959 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.153193 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.153281 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.153520 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.153625 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.153863 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.153960 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.154169 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.154256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.154483 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.154569 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.154806 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.154892 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.155108 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.155194 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.155410 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.155497 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.155717 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.155812 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.156020 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.156107 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.156318 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.156411 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.156618 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.156713 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.156918 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.157005 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.157215 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.157301 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.157513 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.157629 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.157840 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.157926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.158139 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.158268 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.158440 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.158536 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.158742 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.158829 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.159053 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.159139 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.159355 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.159441 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.159656 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.159741 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.159957 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.160050 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.160256 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.160344 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.160557 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.160644 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.160856 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.160943 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.161194 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.161284 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.161496 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.161599 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.161851 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.161992 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.162160 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.162249 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.162477 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.162570 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.162791 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.162894 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.163095 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.163181 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.163408 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.163495 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.163746 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.163844 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.164061 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.164156 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.164373 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.164459 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.164683 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.164778 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.164991 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.165084 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.165302 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.165396 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.165633 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.165735 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.165942 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.166035 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.166255 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.166464 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.166564 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.166795 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.166882 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.167110 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.167372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.167459 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.167698 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.167785 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.168007 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.168102 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.168318 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.168408 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.168626 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.168713 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.168935 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.169021 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.169242 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.169329 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.169562 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.169651 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.169879 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.169975 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.170187 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.170291 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.170493 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.170581 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.170814 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.170902 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.171132 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.171228 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.171443 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.171528 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.171756 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.171851 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.172065 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.172151 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.172372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.172497 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.172691 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.172827 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.172993 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.173097 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.173303 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.173394 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.173643 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.173750 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.173952 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.174039 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.174260 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.174348 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.174566 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.174660 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.174874 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.174960 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.175181 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.175266 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.175489 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.175584 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.175793 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.175879 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.176100 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.176185 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.176404 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.176492 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.176708 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.176794 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.177016 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.177101 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.177322 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.177409 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.177662 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.177751 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.177980 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.178080 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.178293 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.178405 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.178599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.178807 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.178903 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.179122 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.179226 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.179519 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.179751 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.179846 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.180060 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.180198 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.180388 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.180474 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.180708 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.180803 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.181026 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.181122 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.181334 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.181421 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.181663 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.181751 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.181975 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.182096 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.182280 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.182402 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.182579 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.182686 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.182895 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.182992 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.183186 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.183289 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.183485 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.183577 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.183799 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.183885 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.184106 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.184193 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.184404 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.184633 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.184728 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.184984 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.185070 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.185297 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.185532 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.185656 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.185900 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.186048 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.186196 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.186335 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.186520 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.186662 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.186842 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.186979 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.187155 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.187286 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.187457 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.187598 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.187768 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.187910 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.188067 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.188201 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.188369 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.188531 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.188665 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.188807 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.188968 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.189108 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.189265 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.189480 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.189646 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.189732 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.189877 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.189965 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.190179 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.190268 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.190478 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.190573 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.190783 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.190871 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.191082 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.191170 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.191380 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.191464 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.191687 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.191775 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.191986 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.192073 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.192285 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.192418 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.192587 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.192746 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.192885 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.193014 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.193184 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.193272 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.193481 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.193606 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.193803 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.193889 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.194102 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.194188 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.194399 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.194494 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.194698 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.194785 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.195023 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.195111 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.195329 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.195424 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.195634 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.195721 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.195936 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.196022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.196258 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.196353 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.196571 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.196659 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.196878 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.196963 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.197177 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.197264 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.197485 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.197609 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.197816 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.197903 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.198134 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.198223 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.198441 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.198527 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.198748 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.198973 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.199071 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.199310 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.199397 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.199631 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.199904 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.199991 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.200237 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.200377 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.200554 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.200642 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.200868 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.200962 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.201171 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.201259 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.201485 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.201601 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.201813 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.201913 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.202114 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.202201 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.202419 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.202546 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.202726 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.202863 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.203035 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.203124 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.203340 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.203428 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.203646 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.203747 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.203953 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.204040 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.204259 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.204346 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.204564 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.204652 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.204866 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.204952 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.205171 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.205258 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.205476 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.205612 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.205804 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.205890 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.206108 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.206209 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.206413 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.206501 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.206717 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.206803 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.207026 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.207121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.207361 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.207449 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.207677 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.207763 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.207991 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.208089 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.208298 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.208383 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.208606 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.208692 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.208914 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.209017 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.209219 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.209305 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.209524 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.209685 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.209852 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.209942 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.210157 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.210242 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.210536 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.210625 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.210854 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.210942 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.211157 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.211243 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.211527 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.211613 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.211836 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.211930 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.212155 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.212244 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.212471 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.212603 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.212777 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.212898 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.213094 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.213222 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.213400 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.213496 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.213727 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.213815 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.214045 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.214133 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.214353 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.214453 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.214678 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.214765 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.214999 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.215084 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.215304 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.215393 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.215612 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.215700 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.215920 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.216008 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.216219 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.216306 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.216519 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.216609 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.216824 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.216911 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.217125 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.217211 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.217430 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.217516 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.217754 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.217926 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.218052 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.218139 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.218355 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.218441 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.218651 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.218745 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.218948 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.219048 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.219247 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.219333 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.219543 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.219637 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.219842 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.219929 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.220139 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.220224 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.220438 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.220532 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.220737 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.220824 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.221037 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.221123 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.221335 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.221423 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.222012 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.222108 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.222317 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.222411 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.222617 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.222713 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.222916 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.223046 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.223214 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.223295 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.223514 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.223602 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.223812 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.223899 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.224139 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.224226 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.224466 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.224561 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.224777 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.224863 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.225085 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.225183 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.225391 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.225476 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.225736 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.225836 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.226041 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.226155 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.226376 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.226462 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.226693 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.226781 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.227004 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.227098 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.227306 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.227392 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.227616 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.227702 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.227928 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.228024 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.228231 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.228317 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.228539 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.228624 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.228845 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.228973 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.229152 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.229239 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.229503 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.229620 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.229811 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.229898 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.230129 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.230216 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.230430 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.230517 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.230752 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.230847 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.231060 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.231145 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.231375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.231470 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.231687 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.231779 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.231991 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.232077 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.232297 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.232398 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.232606 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.232693 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.232910 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.233004 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.233216 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.233319 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.233522 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.233677 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.233850 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.233937 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.234162 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.234250 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.234468 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.234555 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.234774 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.234861 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.235089 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.235181 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.235400 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.235486 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.235726 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.235812 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.236049 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.236137 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.236354 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.236440 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.236675 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.236761 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.237003 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.237090 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.237335 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.237420 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.237664 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.237767 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.237982 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.238077 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.238289 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.238376 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.238530 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 22:34:07.238629 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.238915 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.239219 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:34:07.239456 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 22:34:07.395073 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Registered counter for database nova_api Aug 01 22:34:07.397045 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO dbcounter [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Registered counter for database nova_api Aug 01 22:34:07.416263 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.418273 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_db.sqlalchemy.engines [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:07.424663 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writer thread running {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:07.479164 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.context [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794832fa-2d4b-444b-8427-3666cab1df17(cell1) {{(pid=109844) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 22:34:07.480080 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.context [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794832fa-2d4b-444b-8427-3666cab1df17(cell1) {{(pid=109845) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 22:34:07.483184 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:34:07.483943 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:34:07.484873 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:34:07.485597 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:34:07.485753 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:34:07.486369 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:34:07.487665 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_concurrency.lockutils [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:34:07.488368 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:34:07.489694 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Registered counter for database nova_cell0 Aug 01 22:34:07.490367 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO dbcounter [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Registered counter for database nova_cell0 Aug 01 22:34:07.495077 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Registered counter for database nova_cell1 Aug 01 22:34:07.495897 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO dbcounter [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Registered counter for database nova_cell1 Aug 01 22:34:07.503648 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.505332 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.509591 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_db.sqlalchemy.engines [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.510834 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_db.sqlalchemy.engines [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.511481 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:07.513753 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:07.517474 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writer thread running {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:07.518962 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writer thread running {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:07.654987 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO dbcounter [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Registered counter for database nova_cell0 Aug 01 22:34:07.661295 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO dbcounter [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Registered counter for database nova_cell0 Aug 01 22:34:07.664639 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG oslo_db.sqlalchemy.engines [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.667979 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_db.sqlalchemy.engines [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:34:07.670201 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writer thread running {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:07.673151 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writer thread running {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:34:08.009167 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:34:08.009741 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: WARNING keystonemiddleware.auth_token [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:34:08.016561 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: WARNING keystonemiddleware.auth_token [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:34:08.016745 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:34:08.363003 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:34:08.365502 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: WARNING keystonemiddleware.auth_token [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:34:08.369008 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: WARNING keystonemiddleware.auth_token [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:34:08.371558 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: WARNING keystonemiddleware.auth_token [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:34:08.374303 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d453ea19c0 pid: 109844 (default app) Aug 01 22:34:08.376397 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:34:08.376794 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d453ea19c0 pid: 109845 (default app) Aug 01 22:34:08.377614 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-00e30700-0c6c-4ab1-82f4-c47f87cd0736 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 Aug 01 22:34:08.378050 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Mon Aug 1 22:34:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:23.805891 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:23.807173 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Aug 01 22:35:23.807778 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:23.818752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_api:SELECT=3 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:23.819900 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_cell1:SELECT=3 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:23.820831 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_cell0:SELECT=3 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:23.821759 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:24.786779 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-cf305866-4574-45d1-99b8-e874d672d256 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:24.819272 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-cf305866-4574-45d1-99b8-e874d672d256 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.005864 Aug 01 22:35:24.819934 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Aug 1 22:35:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:35:27.004860 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:27.005946 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-0964a21f-68c9-4eb8-9493-bd9b24dd16ee None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 01 22:35:27.006341 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 2/4] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:27.471910 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-d402ccad-2340-48c7-a835-ced9f41bdc04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:27.491676 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:35:27.491676 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: warnings.warn(msg) Aug 01 22:35:27.521524 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-d402ccad-2340-48c7-a835-ced9f41bdc04 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505229 Aug 01 22:35:27.529319 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 3/5] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:35:27.738327 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-9275f39d-b0ce-406c-9d58-7832b27097df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:27.742833 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:35:27.742833 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: warnings.warn(msg) Aug 01 22:35:27.745745 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_api:SELECT=3 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:27.746632 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_cell0:SELECT=3 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:27.747677 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_cell1:SELECT=3 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:27.748439 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:27.822286 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-9275f39d-b0ce-406c-9d58-7832b27097df admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291617 Aug 01 22:35:27.829008 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 3/6] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Aug 1 22:35:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:35:30.021137 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-d402ccad-2340-48c7-a835-ced9f41bdc04 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:30.022247 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-d402ccad-2340-48c7-a835-ced9f41bdc04 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 01 22:35:30.022626 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 4/7] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:30.694901 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-960ba99b-3717-4a30-b368-16c2cd7ba0ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:30.714172 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:35:30.714172 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: warnings.warn(msg) Aug 01 22:35:30.737946 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-960ba99b-3717-4a30-b368-16c2cd7ba0ed admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.709274 Aug 01 22:35:30.745755 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 4/8] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:35:30.752946 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-bc2b1249-fbb2-4dad-bda2-02a55b0afa58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:30.756038 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:35:30.756038 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: warnings.warn(msg) Aug 01 22:35:30.793478 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-bc2b1249-fbb2-4dad-bda2-02a55b0afa58 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044575 Aug 01 22:35:30.794378 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 5/9] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Aug 1 22:35:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:35:32.993312 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-960ba99b-3717-4a30-b368-16c2cd7ba0ed admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:32.996978 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-960ba99b-3717-4a30-b368-16c2cd7ba0ed admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004851 Aug 01 22:35:32.997387 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:33.414875 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2e8d74e4-2213-40db-88c8-d5beace073e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:33.435670 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2e8d74e4-2213-40db-88c8-d5beace073e4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431930 Aug 01 22:35:33.436264 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 6/11] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:35:33.448890 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-25eeb2d9-a936-47d2-a7ee-1aed99402abe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:33.475030 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-25eeb2d9-a936-47d2-a7ee-1aed99402abe admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030340 Aug 01 22:35:33.475757 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 6/12] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Aug 1 22:35:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:35:35.690327 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-2e8d74e4-2213-40db-88c8-d5beace073e4 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:35.691238 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-2e8d74e4-2213-40db-88c8-d5beace073e4 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 01 22:35:35.691640 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 7/13] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:36.122586 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-b591b73d-483d-4f10-a5c6-910527a5960c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:36.146065 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-b591b73d-483d-4f10-a5c6-910527a5960c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448334 Aug 01 22:35:36.146571 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 7/14] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:35:36.159554 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-215a7b05-c624-47fa-973b-6d98cd8a8189 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:36.190050 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-215a7b05-c624-47fa-973b-6d98cd8a8189 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033455 Aug 01 22:35:36.191016 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 8/15] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Aug 1 22:35:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:35:38.398073 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-b591b73d-483d-4f10-a5c6-910527a5960c admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:38.399098 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-b591b73d-483d-4f10-a5c6-910527a5960c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 01 22:35:38.399756 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 8/16] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:38.821348 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-63afebaf-dd61-4fa9-88fe-8a692c92170a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "ram": 4096, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:38.843628 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-63afebaf-dd61-4fa9-88fe-8a692c92170a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437865 Aug 01 22:35:38.844265 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 9/17] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:35:38.856441 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-de38de83-8002-443b-9963-3c3e16595e5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:38.882206 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-de38de83-8002-443b-9963-3c3e16595e5b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029283 Aug 01 22:35:38.883080 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 9/18] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Aug 1 22:35:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:35:41.105626 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-63afebaf-dd61-4fa9-88fe-8a692c92170a admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:41.106664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-63afebaf-dd61-4fa9-88fe-8a692c92170a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Aug 01 22:35:41.107079 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 10/19] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:35:41.560912 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-f00c39df-bbbf-40da-b262-6b3efbab9b06 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:41.586197 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-f00c39df-bbbf-40da-b262-6b3efbab9b06 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.472749 Aug 01 22:35:41.586766 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 10/20] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Aug 1 22:35:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:35:43.845107 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-63afebaf-dd61-4fa9-88fe-8a692c92170a admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:43.846311 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-63afebaf-dd61-4fa9-88fe-8a692c92170a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Aug 01 22:35:43.846729 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 11/21] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:44.312983 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-2bcb3d23-6a6a-4032-8bfb-293f6687a128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "name": "m1.tiny"}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:44.335140 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-2bcb3d23-6a6a-4032-8bfb-293f6687a128 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.481430 Aug 01 22:35:44.335700 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 11/22] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:35:44.350025 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-246ce998-6339-427d-84fd-e9c23c435fd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:44.375306 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-246ce998-6339-427d-84fd-e9c23c435fd1 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029284 Aug 01 22:35:44.375940 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 12/23] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Aug 1 22:35:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:35:46.561757 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-2bcb3d23-6a6a-4032-8bfb-293f6687a128 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:46.562774 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-2bcb3d23-6a6a-4032-8bfb-293f6687a128 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 01 22:35:46.563136 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 12/24] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:46.966292 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-ee6003ee-c958-45f9-b9aa-d31f1712f365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "name": "m1.small", "disk": 20}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:46.990031 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-ee6003ee-c958-45f9-b9aa-d31f1712f365 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420540 Aug 01 22:35:46.991050 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 13/25] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:35:47.003376 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-a3b4f716-fda6-48fe-bb3a-fc77bae8629c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:47.029346 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-a3b4f716-fda6-48fe-bb3a-fc77bae8629c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029635 Aug 01 22:35:47.030061 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 13/26] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Aug 1 22:35:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:35:49.244867 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-ee6003ee-c958-45f9-b9aa-d31f1712f365 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:49.247760 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-ee6003ee-c958-45f9-b9aa-d31f1712f365 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003795 Aug 01 22:35:49.249446 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 14/27] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:49.642492 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-7b03bc14-8108-4c4a-9a12-c2abd3c57f2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:49.662267 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-7b03bc14-8108-4c4a-9a12-c2abd3c57f2b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.407397 Aug 01 22:35:49.663059 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 14/28] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:35:49.676122 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-8e8a6c08-97a0-4e30-aa26-fbea3fc32c6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:49.700782 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-8e8a6c08-97a0-4e30-aa26-fbea3fc32c6d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028416 Aug 01 22:35:49.701362 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 15/29] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Aug 1 22:35:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:35:51.937887 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-7b03bc14-8108-4c4a-9a12-c2abd3c57f2b admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:51.938933 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-7b03bc14-8108-4c4a-9a12-c2abd3c57f2b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 01 22:35:51.939378 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 15/30] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:52.387107 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-e54c846e-9c9d-4397-a490-34b8d2c95a47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "id": "4", "vcpus": 4}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:52.408427 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-e54c846e-9c9d-4397-a490-34b8d2c95a47 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459542 Aug 01 22:35:52.409324 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 16/31] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:35:52.421271 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-06b67a45-feca-4f0f-9bc4-8eba9adfa4ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:52.447503 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-06b67a45-feca-4f0f-9bc4-8eba9adfa4ad admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030037 Aug 01 22:35:52.448420 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 16/32] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Aug 1 22:35:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:35:54.637856 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-e54c846e-9c9d-4397-a490-34b8d2c95a47 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:35:54.638859 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-e54c846e-9c9d-4397-a490-34b8d2c95a47 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 01 22:35:54.639828 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 17/33] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:35:55.151963 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-4c6fc8d2-ebfb-4ac4-9631-e4a9e37eab91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:55.177124 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-4c6fc8d2-ebfb-4ac4-9631-e4a9e37eab91 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.530233 Aug 01 22:35:55.177874 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 17/34] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Aug 1 22:35:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:35:55.189786 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-5f2d0271-14c3-4c3c-9191-9f512461c817 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:35:55.200281 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:35:55.219322 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-5f2d0271-14c3-4c3c-9191-9f512461c817 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033296 Aug 01 22:35:55.219906 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 18/35] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Aug 1 22:35:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:36:15.109971 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-4c6fc8d2-ebfb-4ac4-9631-e4a9e37eab91 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:15.111228 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-4c6fc8d2-ebfb-4ac4-9631-e4a9e37eab91 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Aug 01 22:36:15.111749 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 18/36] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:15.563708 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-01781fd2-3520-415d-9446-65c1209a4834 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:15.587833 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-01781fd2-3520-415d-9446-65c1209a4834 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.469747 Aug 01 22:36:15.588385 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 19/37] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Aug 1 22:36:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:36:16.670160 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-4c6fc8d2-ebfb-4ac4-9631-e4a9e37eab91 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:16.671158 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-4c6fc8d2-ebfb-4ac4-9631-e4a9e37eab91 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 01 22:36:16.671578 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 19/38] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:17.246517 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fb041506-3042-47f7-8b3a-5c0ed17a91b1 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:17.253312 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.wsgi [None req-fb041506-3042-47f7-8b3a-5c0ed17a91b1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fb041506-3042-47f7-8b3a-5c0ed17a91b1 admin admin] Request method failure captured: Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Accept: application/json Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Accept-Encoding: gzip, deflate Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Connection: keep-alive Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Content-Length: 0 Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Host: 10.222.0.47 Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Openstack-Api-Version: compute 2.90 Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Openstack-System-Scope: None Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: User-Agent: python-novaclient Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Auth-Token: gAAAAABi6FVgouVy6VNErde5AJa1bcmvq1Vzzo_y0SCA7SYymJfe7fZOTqZDD12X2Ov2Ze5OQUQl9hucxmVJlxmOiS6GQ6AWtD5iehdkUqE6NiQ_tvmZhKPuUIyxh5bw98DZObdRzTI34D6d8spx5neRCXCdxxLF58vnTMIoZUFvC8Q3x7-yv4I Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Domain-Id: None Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Domain-Name: None Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Identity-Status: Confirmed Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Is-Admin-Project: True Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Domain-Id: default Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Domain-Name: Default Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Name: admin Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Role: member,admin,reader Aug 01 22:36:17.256664 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Roles: member,admin,reader Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e92bd71b1dab4dce929247e99aba6067", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant: admin Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant-Name: admin Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User: admin Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Domain-Id: default Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Domain-Name: Default Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Id: 47de1e2ad35749d7a331fc838348d562 Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Name: admin Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: method: > Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: exception: Flavor 42 could not be found. Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: action_args: {'id': '42'} Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:36:17.258342 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:17.259499 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.260886 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fb041506-3042-47f7-8b3a-5c0ed17a91b1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:36:17.262263 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fb041506-3042-47f7-8b3a-5c0ed17a91b1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.445489 Aug 01 22:36:17.262263 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 20/39] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 1 22:36:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 22:36:17.270908 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-fb22eb4a-5074-4c68-832a-54d714983797 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:17.277144 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:36:17.297910 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-fb22eb4a-5074-4c68-832a-54d714983797 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032920 Aug 01 22:36:17.298455 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 20/40] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 1 22:36:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:36:17.308387 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-eb5af409-e29f-4ec9-a471-61f5149d935a admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:17.332731 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-eb5af409-e29f-4ec9-a471-61f5149d935a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027943 Aug 01 22:36:17.333263 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 21/41] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 1 22:36:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:36:17.343772 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-bb99fe9b-f344-466d-96ed-b57c5a9154f8 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:17.350170 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.wsgi [None req-bb99fe9b-f344-466d-96ed-b57c5a9154f8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-bb99fe9b-f344-466d-96ed-b57c5a9154f8 admin admin] Request method failure captured: Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Accept: application/json Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Accept-Encoding: gzip, deflate Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Connection: keep-alive Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Content-Length: 0 Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Host: 10.222.0.47 Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Openstack-Api-Version: compute 2.90 Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Openstack-System-Scope: None Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: User-Agent: python-novaclient Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Auth-Token: gAAAAABi6FVgouVy6VNErde5AJa1bcmvq1Vzzo_y0SCA7SYymJfe7fZOTqZDD12X2Ov2Ze5OQUQl9hucxmVJlxmOiS6GQ6AWtD5iehdkUqE6NiQ_tvmZhKPuUIyxh5bw98DZObdRzTI34D6d8spx5neRCXCdxxLF58vnTMIoZUFvC8Q3x7-yv4I Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Domain-Id: None Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Domain-Name: None Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Identity-Status: Confirmed Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Is-Admin-Project: True Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Domain-Id: default Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Domain-Name: Default Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Name: admin Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Role: member,admin,reader Aug 01 22:36:17.353375 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Roles: member,admin,reader Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e92bd71b1dab4dce929247e99aba6067", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant: admin Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant-Name: admin Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User: admin Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Domain-Id: default Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Domain-Name: Default Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Id: 47de1e2ad35749d7a331fc838348d562 Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Name: admin Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: method: > Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: exception: Flavor 42 could not be found. Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: action_args: {'id': '42'} Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:36:17.354905 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:17.355719 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:17.356926 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-bb99fe9b-f344-466d-96ed-b57c5a9154f8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:36:17.358191 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-bb99fe9b-f344-466d-96ed-b57c5a9154f8 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015471 Aug 01 22:36:17.358191 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 21/42] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 1 22:36:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 22:36:18.347195 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-eb5af409-e29f-4ec9-a471-61f5149d935a admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:18.348208 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-eb5af409-e29f-4ec9-a471-61f5149d935a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 01 22:36:18.348602 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 22/43] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:18.897040 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-48894132-a257-4356-ae77-36d64d4f4510 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:18.907902 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.wsgi [None req-48894132-a257-4356-ae77-36d64d4f4510 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-48894132-a257-4356-ae77-36d64d4f4510 admin admin] Request method failure captured: Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Accept: application/json Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Accept-Encoding: gzip, deflate Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Connection: keep-alive Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Content-Length: 0 Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Host: 10.222.0.47 Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Openstack-Api-Version: compute 2.90 Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Openstack-System-Scope: None Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: User-Agent: python-novaclient Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Auth-Token: gAAAAABi6FVimcyQWkJwA5eMEtNwyciNj8z9dEClROpEoaFb8FSpDfPv7KTiK2LTIkkhFdr-BegR4a9ujOc_WFhOrYKu4DlTXgNrNIpUYH1Sg6onnZCQswPDK96Uq1-Y4uGm3ObXmPoxgp-seWri6iZMuQgFvLdEUoMMXBalMHaXXrWz1-es9a4 Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Domain-Id: None Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Domain-Name: None Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Identity-Status: Confirmed Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Is-Admin-Project: True Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Domain-Id: default Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Domain-Name: Default Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Name: admin Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Role: member,admin,reader Aug 01 22:36:18.909345 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Roles: member,admin,reader Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e92bd71b1dab4dce929247e99aba6067", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant: admin Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant-Name: admin Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User: admin Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Domain-Id: default Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Domain-Name: Default Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Id: 47de1e2ad35749d7a331fc838348d562 Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Name: admin Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: method: > Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: exception: Flavor 84 could not be found. Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: action_args: {'id': '84'} Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:36:18.910995 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:18.912044 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.913458 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-48894132-a257-4356-ae77-36d64d4f4510 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:36:18.914724 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-48894132-a257-4356-ae77-36d64d4f4510 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.425093 Aug 01 22:36:18.914724 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 22/44] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 1 22:36:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 22:36:18.920539 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-accaa302-259c-4b87-92e0-f1e9a1ddd9c4 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:18.935559 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-accaa302-259c-4b87-92e0-f1e9a1ddd9c4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018715 Aug 01 22:36:18.936080 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 23/45] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 1 22:36:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:36:18.945794 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-4a8e7d36-b172-4e44-8928-82585b9a0762 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:18.960910 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-4a8e7d36-b172-4e44-8928-82585b9a0762 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018626 Aug 01 22:36:18.961430 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 1 22:36:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:36:18.975824 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-7dfbdc67-d81a-405d-a9c6-c3610ff1d7bc admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:18.983936 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.wsgi [None req-7dfbdc67-d81a-405d-a9c6-c3610ff1d7bc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-7dfbdc67-d81a-405d-a9c6-c3610ff1d7bc admin admin] Request method failure captured: Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Accept: application/json Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Accept-Encoding: gzip, deflate Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Connection: keep-alive Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Content-Length: 0 Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Host: 10.222.0.47 Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Openstack-Api-Version: compute 2.90 Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Openstack-System-Scope: None Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: User-Agent: python-novaclient Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Auth-Token: gAAAAABi6FVimcyQWkJwA5eMEtNwyciNj8z9dEClROpEoaFb8FSpDfPv7KTiK2LTIkkhFdr-BegR4a9ujOc_WFhOrYKu4DlTXgNrNIpUYH1Sg6onnZCQswPDK96Uq1-Y4uGm3ObXmPoxgp-seWri6iZMuQgFvLdEUoMMXBalMHaXXrWz1-es9a4 Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Domain-Id: None Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Domain-Name: None Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Identity-Status: Confirmed Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Is-Admin-Project: True Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Domain-Id: default Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Domain-Name: Default Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Name: admin Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Role: member,admin,reader Aug 01 22:36:18.986256 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Roles: member,admin,reader Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e92bd71b1dab4dce929247e99aba6067", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant: admin Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant-Name: admin Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User: admin Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Domain-Id: default Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Domain-Name: Default Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Id: 47de1e2ad35749d7a331fc838348d562 Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Name: admin Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: method: > Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: exception: Flavor 84 could not be found. Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: action_args: {'id': '84'} Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:36:18.987752 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:18.988700 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:18.990022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-7dfbdc67-d81a-405d-a9c6-c3610ff1d7bc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:36:18.991257 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-7dfbdc67-d81a-405d-a9c6-c3610ff1d7bc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017586 Aug 01 22:36:18.991257 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 24/47] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Aug 1 22:36:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 22:36:19.981392 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-4a8e7d36-b172-4e44-8928-82585b9a0762 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:19.982702 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-4a8e7d36-b172-4e44-8928-82585b9a0762 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Aug 01 22:36:19.983178 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 24/48] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:20.548550 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-7d8b2f00-feed-4318-8ee3-d68bc2fb9cd9 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:20.554389 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.wsgi [None req-7d8b2f00-feed-4318-8ee3-d68bc2fb9cd9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-7d8b2f00-feed-4318-8ee3-d68bc2fb9cd9 admin admin] Request method failure captured: Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Accept: application/json Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Accept-Encoding: gzip, deflate Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Connection: keep-alive Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Content-Length: 0 Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Host: 10.222.0.47 Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Openstack-Api-Version: compute 2.90 Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Openstack-System-Scope: None Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: User-Agent: python-novaclient Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Auth-Token: gAAAAABi6FVjs44-1iPDTUfyXY10ypz0PUOj7M9rqzAVm-9xqEv-4kB5vwUY8Q1LJ32CYj91Pfi-b7ta69olArQz4OFUY9s-qpbIyY0iUmLtxdwssmmiYQyC0X5I1RA4G1-7ghOW3jbd2mBoRh-YXr_UbWo2xjZJbUWBybesQO3ND0IWJQTKSjk Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Domain-Id: None Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Domain-Name: None Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Identity-Status: Confirmed Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Is-Admin-Project: True Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Domain-Id: default Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Domain-Name: Default Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Project-Name: admin Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Role: member,admin,reader Aug 01 22:36:20.555888 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Roles: member,admin,reader Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e92bd71b1dab4dce929247e99aba6067", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant: admin Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-Tenant-Name: admin Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User: admin Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Domain-Id: default Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Domain-Name: Default Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Id: 47de1e2ad35749d7a331fc838348d562 Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: X-User-Name: admin Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: method: > Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: exception: Flavor 451 could not be found. Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: action_args: {'id': '451'} Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:36:20.557398 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:20.558757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.560121 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-7d8b2f00-feed-4318-8ee3-d68bc2fb9cd9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:36:20.561406 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-7d8b2f00-feed-4318-8ee3-d68bc2fb9cd9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.437580 Aug 01 22:36:20.561406 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 25/49] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 1 22:36:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 22:36:20.567098 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-c8afee04-4033-4983-bb2a-8efbccd92192 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:20.583053 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-c8afee04-4033-4983-bb2a-8efbccd92192 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019579 Aug 01 22:36:20.583574 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 25/50] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 1 22:36:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:36:20.593526 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:20.608693 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019130 Aug 01 22:36:20.609217 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 26/51] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Aug 1 22:36:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:36:20.621267 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-83b93940-6ffc-408a-8e9a-9e7403226620 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:20.629916 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.wsgi [None req-83b93940-6ffc-408a-8e9a-9e7403226620 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-83b93940-6ffc-408a-8e9a-9e7403226620 admin admin] Request method failure captured: Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Accept: application/json Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Accept-Encoding: gzip, deflate Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Connection: keep-alive Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Content-Length: 0 Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Host: 10.222.0.47 Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Openstack-Api-Version: compute 2.90 Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Openstack-System-Scope: None Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: User-Agent: python-novaclient Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Auth-Token: gAAAAABi6FVjs44-1iPDTUfyXY10ypz0PUOj7M9rqzAVm-9xqEv-4kB5vwUY8Q1LJ32CYj91Pfi-b7ta69olArQz4OFUY9s-qpbIyY0iUmLtxdwssmmiYQyC0X5I1RA4G1-7ghOW3jbd2mBoRh-YXr_UbWo2xjZJbUWBybesQO3ND0IWJQTKSjk Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Domain-Id: None Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Domain-Name: None Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Identity-Status: Confirmed Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Is-Admin-Project: True Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Domain-Id: default Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Domain-Name: Default Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Project-Name: admin Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Role: member,admin,reader Aug 01 22:36:20.632372 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Roles: member,admin,reader Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e92bd71b1dab4dce929247e99aba6067", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e92bd71b1dab4dce929247e99aba6067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant: admin Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant-Id: e92bd71b1dab4dce929247e99aba6067 Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-Tenant-Name: admin Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User: admin Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Domain-Id: default Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Domain-Name: Default Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Id: 47de1e2ad35749d7a331fc838348d562 Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: X-User-Name: admin Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: method: > Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: exception: Flavor 451 could not be found. Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: action_args: {'id': '451'} Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:36:20.634956 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:20.636599 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: ERROR nova.api.openstack.wsgi Aug 01 22:36:20.638789 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-83b93940-6ffc-408a-8e9a-9e7403226620 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:36:20.640735 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-83b93940-6ffc-408a-8e9a-9e7403226620 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018902 Aug 01 22:36:20.640735 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 26/52] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 1 22:36:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 22:36:21.619032 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:21.620056 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 01 22:36:21.620421 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 27/53] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:22.184790 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-e14c801f-ed88-4537-8339-d2a6568ead1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:36:22.208180 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-e14c801f-ed88-4537-8339-d2a6568ead1f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.450815 Aug 01 22:36:22.208748 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 27/54] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 1 22:36:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:36:23.206022 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:23.207180 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Aug 01 22:36:23.207583 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 28/55] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:23.785140 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-7378c7d8-323c-4dc7-a348-1db335d8c01d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:36:23.806400 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-7378c7d8-323c-4dc7-a348-1db335d8c01d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.463221 Aug 01 22:36:23.806946 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 28/56] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 1 22:36:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:36:24.790469 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:24.791473 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 01 22:36:24.791938 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 29/57] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:25.460075 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-9ca56ed5-1636-4cf8-a182-4d1e7267776b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:36:25.483605 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-9ca56ed5-1636-4cf8-a182-4d1e7267776b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.555483 Aug 01 22:36:25.484083 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 29/58] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 1 22:36:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:36:26.470100 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:26.471727 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Aug 01 22:36:26.472129 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 30/59] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:27.027934 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-0245c9c0-3382-45c5-90b5-4415ef2c7d2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:36:27.048549 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-0245c9c0-3382-45c5-90b5-4415ef2c7d2d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.441133 Aug 01 22:36:27.049103 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 30/60] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Aug 1 22:36:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:36:28.021324 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:28.022370 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 01 22:36:28.022775 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 31/61] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:36:28.635585 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-4db4c6cc-24be-4a6b-945d-f35782735356 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:36:28.655708 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-4db4c6cc-24be-4a6b-945d-f35782735356 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.495987 Aug 01 22:36:28.656312 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 31/62] 10.222.0.47 () {60 vars in 1202 bytes} [Mon Aug 1 22:36:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:37:20.491505 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:37:20.492520 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-a5c43383-2cbd-44d2-92b8-5ca849dcb942 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 01 22:37:20.492934 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 32/63] 10.222.0.47 () {54 vars in 930 bytes} [Mon Aug 1 22:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:37:20.506350 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:37:20.898934 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-ad3195dc-dc71-40e1-bbb4-d1df16c15deb admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:37:20.919827 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-ad3195dc-dc71-40e1-bbb4-d1df16c15deb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420390 Aug 01 22:37:20.920374 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 32/64] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Aug 1 22:37:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:37:20.942821 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG dbcounter [-] [109844] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:37:20.948018 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-e9dc16b3-b7c0-47be-aab8-5220fe5547d4 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:37:20.960341 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-e9dc16b3-b7c0-47be-aab8-5220fe5547d4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019675 Aug 01 22:37:20.961069 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 33/65] 10.222.0.47 () {60 vars in 1282 bytes} [Mon Aug 1 22:37:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:37:20.975922 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-74330528-4d85-46e5-bc05-2f39e8f30689 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:37:20.983786 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-74330528-4d85-46e5-bc05-2f39e8f30689 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011479 Aug 01 22:37:20.984306 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 33/66] 10.222.0.47 () {60 vars in 1285 bytes} [Mon Aug 1 22:37:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:37:20.995704 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:37:21.004122 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011919 Aug 01 22:37:21.004666 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 34/67] 10.222.0.47 () {60 vars in 1285 bytes} [Mon Aug 1 22:37:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:37:21.016553 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-531ecce1-2432-430d-98e8-ce377c2bea8c admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:37:21.025401 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-531ecce1-2432-430d-98e8-ce377c2bea8c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012429 Aug 01 22:37:21.025983 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 34/68] 10.222.0.47 () {60 vars in 1282 bytes} [Mon Aug 1 22:37:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:41:06.817066 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:06.818896 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002598 Aug 01 22:41:06.819596 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 35/69] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:41:07.050632 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_api:SELECT=6 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:41:07.273513 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-3a5b580d-fd45-49e3-9172-76a42fda77c3 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:07.276028 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:41:07.276028 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: warnings.warn(msg) Aug 01 22:41:07.277365 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-3a5b580d-fd45-49e3-9172-76a42fda77c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:07.277828 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-3a5b580d-fd45-49e3-9172-76a42fda77c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:07.278615 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-3a5b580d-fd45-49e3-9172-76a42fda77c3 admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:07.279028 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-3a5b580d-fd45-49e3-9172-76a42fda77c3 admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:07.314676 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-3a5b580d-fd45-49e3-9172-76a42fda77c3 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.265262 Aug 01 22:41:07.315183 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 35/70] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 1 22:41:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:41:08.285328 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:08.286376 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 01 22:41:08.286757 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 36/71] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:41:08.503705 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-50cd11e2-2073-46fa-a952-dfd510bdfa12 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:08.506230 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:41:08.506230 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: warnings.warn(msg) Aug 01 22:41:08.507490 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-50cd11e2-2073-46fa-a952-dfd510bdfa12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:08.507933 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-50cd11e2-2073-46fa-a952-dfd510bdfa12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:08.508726 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-50cd11e2-2073-46fa-a952-dfd510bdfa12 admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:08.509146 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-50cd11e2-2073-46fa-a952-dfd510bdfa12 admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:08.529261 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-50cd11e2-2073-46fa-a952-dfd510bdfa12 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082345 Aug 01 22:41:08.529786 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 36/72] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 1 22:41:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:41:19.816378 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:19.817376 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 01 22:41:19.817809 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 37/73] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:41:19.962237 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_cell0:SELECT=4 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:41:19.963575 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_cell1:SELECT=4 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:41:19.964391 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG dbcounter [-] [109845] Writing DB stats nova_api:SELECT=8 {{(pid=109845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:41:20.016529 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-81394af0-20c3-4744-8422-5e33d049b62c admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:20.018942 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:41:20.018942 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: warnings.warn(msg) Aug 01 22:41:20.020159 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-81394af0-20c3-4744-8422-5e33d049b62c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:20.020595 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-81394af0-20c3-4744-8422-5e33d049b62c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:20.021588 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-81394af0-20c3-4744-8422-5e33d049b62c admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:20.022020 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-81394af0-20c3-4744-8422-5e33d049b62c admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:20.047276 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-81394af0-20c3-4744-8422-5e33d049b62c admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092236 Aug 01 22:41:20.048243 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 37/74] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 1 22:41:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:41:20.881856 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: DEBUG nova.api.openstack.wsgi [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] Calling method '>' {{(pid=109844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:20.882859 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: INFO nova.api.openstack.requestlog [None req-fd5f69cb-ef31-4f6f-b6ae-fbada2ec9f94 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 01 22:41:20.883318 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: [pid: 109844|app: 0|req: 38/75] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Aug 1 22:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:41:21.077546 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG nova.api.openstack.wsgi [None req-7c935ef7-180f-4e8a-84b7-89137cef3d70 admin admin] Calling method '>' {{(pid=109845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:41:21.079923 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 22:41:21.079923 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: warnings.warn(msg) Aug 01 22:41:21.081118 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-7c935ef7-180f-4e8a-84b7-89137cef3d70 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:21.081585 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-7c935ef7-180f-4e8a-84b7-89137cef3d70 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:21.082378 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-7c935ef7-180f-4e8a-84b7-89137cef3d70 admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:41:21.082801 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: DEBUG oslo_concurrency.lockutils [None req-7c935ef7-180f-4e8a-84b7-89137cef3d70 admin admin] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:41:21.104417 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: INFO nova.api.openstack.requestlog [None req-7c935ef7-180f-4e8a-84b7-89137cef3d70 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084146 Aug 01 22:41:21.104949 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: [pid: 109845|app: 0|req: 38/76] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Aug 1 22:41:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:42:18.342245 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: Mon Aug 1 22:42:18 2022 - graceful shutdown triggered... Aug 01 22:42:18.342916 dv-cinder-851640-1-iscsi devstack@n-api.service[109844]: Gracefully killing worker 1 (pid: 109844)... Aug 01 22:42:18.342400 dv-cinder-851640-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 22:42:18.343730 dv-cinder-851640-1-iscsi devstack@n-api.service[109845]: Gracefully killing worker 2 (pid: 109845)... Aug 01 22:42:19.343020 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: worker 1 buried after 1 seconds Aug 01 22:42:19.343020 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: worker 2 buried after 1 seconds Aug 01 22:42:19.343020 dv-cinder-851640-1-iscsi devstack@n-api.service[109843]: goodbye to uWSGI. Aug 01 22:42:19.345320 dv-cinder-851640-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 22:42:19.346258 dv-cinder-851640-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 22:42:19.350725 dv-cinder-851640-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 22:42:19.362583 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 22:42:19 2022] *** Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: nodename: dv-cinder-851640-1-iscsi Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: machine: x86_64 Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: clock source: unix Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: pcre jit disabled Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: detected number of CPU cores: 4 Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: current working directory: / Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: detected binary path: /usr/bin/uwsgi-core Aug 01 22:42:19.364625 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: your processes number limit is 47680 Aug 01 22:42:19.365383 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: your memory page size is 4096 bytes Aug 01 22:42:19.365383 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: detected max file descriptor number: 2048 Aug 01 22:42:19.365383 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: lock engine: pthread robust mutexes Aug 01 22:42:19.365383 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: thunder lock: enabled Aug 01 22:42:19.365383 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 22:42:19.365383 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 22:42:19.404131 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: Python main interpreter initialized at 0x556fdaec49c0 Aug 01 22:42:19.404131 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: python threads support enabled Aug 01 22:42:19.404131 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: your server socket listen backlog is limited to 100 connections Aug 01 22:42:19.404131 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: your mercy for graceful operations on workers is 90 seconds Aug 01 22:42:19.404556 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 22:42:19.404556 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: *** Operational MODE: preforking *** Aug 01 22:42:19.404827 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: *** uWSGI is running in multiple interpreter mode *** Aug 01 22:42:19.404827 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: spawned uWSGI master process (pid: 124344) Aug 01 22:42:19.405059 dv-cinder-851640-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 22:42:19.405699 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: spawned uWSGI worker 1 (pid: 124356, cores: 1) Aug 01 22:42:19.405948 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: spawned uWSGI worker 2 (pid: 124358, cores: 1) Aug 01 22:42:19.406109 dv-cinder-851640-1-iscsi devstack@n-api.service[124344]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 22:42:20.061037 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 22:42:20.085648 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 22:42:21.206232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:42:21.206232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: from cryptography.utils import int_from_bytes Aug 01 22:42:21.206882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:42:21.206882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: from cryptography.utils import int_from_bytes Aug 01 22:42:21.231016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:42:21.231016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: from cryptography.utils import int_from_bytes Aug 01 22:42:21.231633 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 22:42:21.231633 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: from cryptography.utils import int_from_bytes Aug 01 22:42:23.614326 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 22:42:23.614924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 22:42:23.615202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 22:42:23.615524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 22:42:23.615742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 22:42:23.616165 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.616484 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.616782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.617103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.617446 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.617773 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.618137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.618448 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.618776 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.619026 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.619349 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.619663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-1-iscsi {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.619982 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.620467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.620876 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.621167 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.621490 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.621851 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.622215 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.622668 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.623430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.623745 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.624170 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.624497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.624845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.625146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.625453 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.625817 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.626122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.626454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.626858 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-1-iscsi {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.627180 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.627489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.627805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.628216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.628525 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.628829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.629147 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.629470 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.629826 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.630149 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.630471 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.630789 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.631112 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.631417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.631736 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.632048 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.632366 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.632678 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.632977 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.633242 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.633539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.633890 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.634208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.634536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.634790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.635040 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.635368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.635671 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.635979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.636370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.636677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.636986 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.637292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.637619 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.637931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.638234 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.638553 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.638868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.639191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.639500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.639819 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.640222 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.640473 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.640782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.641127 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.641462 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.641807 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.642128 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.642448 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.642756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.643066 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.643374 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.643698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.644034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.644342 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.644582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.644879 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.645187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.645684 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.646130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 22:42:23.646645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.646790 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 22:42:23.646938 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.647078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 22:42:23.647232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.647232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.647515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 22:42:23.647515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 22:42:23.647798 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.647798 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.648118 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.648275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.648422 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.648568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.648707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.648854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.649000 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.649150 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.649298 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.649452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.649626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.649780 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.649948 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.650089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.650228 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.650412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.650561 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.650708 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.650862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.651003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.651143 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.651282 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.651581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-1-iscsi {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.651730 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.651880 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.652039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.652185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.652339 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.652490 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.653197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.653370 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.653743 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.653908 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.654155 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.654301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.654449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.654598 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.654750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.654750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.655127 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.655298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.655457 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.655600 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.655759 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.655909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.656058 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.656243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.656388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.656540 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.656692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.656834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.656973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.657122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.657268 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.657420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.657604 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.657752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.657901 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.658051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.658190 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.658338 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.658338 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.658628 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-1-iscsi {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.658770 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.658915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.659069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.659216 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.659362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.659760 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.659931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.660147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.660403 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.660556 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.660714 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.660872 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.661014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.661159 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.661308 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.661455 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.661781 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.661944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.662085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.662233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.662373 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.662536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.662819 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.662997 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.663151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.663304 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.663452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.663611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.663918 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.664075 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.664318 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.664479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.664630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.664771 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.664936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.665265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.665428 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.665633 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.665798 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.665948 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.666090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.666237 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.666386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.666533 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.666682 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.666829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.666975 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.667123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.667123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.667516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.667674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.667816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.668147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.668304 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.668451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.668592 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.668739 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.668886 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.669033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.669194 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.669335 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.669481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.669652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.669795 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.669952 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.670101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.670249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.670390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.670536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.670677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.670830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.670971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.671122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.671267 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.671407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.671547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.671719 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.672009 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.672153 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.672303 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.672445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.672591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.672741 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.672889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.673028 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.673187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.673333 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.673482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.673691 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.674054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.674220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.674459 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.674607 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.674761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.674902 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.675040 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.675180 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.675428 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.675612 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.675832 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.675987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.676135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.676275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.676414 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.676554 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.676703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.676850 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.676989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.677134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.677274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.677647 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.677804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.677945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.678084 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.678222 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.678370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.678518 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.678667 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.678816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.678956 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.679106 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.679259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.679399 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.679551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.679700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.679840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.679992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.680140 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.680281 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.680421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.680567 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.680707 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.680862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.680862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.681146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.681292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.681443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.681613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.681770 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.682074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.682221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.682369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.682526 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.682675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.682836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.682836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.683135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.683275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.683425 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.683565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.683712 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.683712 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.683994 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.684318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.684491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.684491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.684843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.684843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.685159 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.685319 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.685587 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.685755 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.685900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.686049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.686239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.686400 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.686542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.686689 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.686831 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.686970 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.687110 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.687341 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.687496 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.687645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.687786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.687933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.688075 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.688224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.688365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.688504 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.688643 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.688782 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.688929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.689078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.689244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.689386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.689525 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.689700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.689857 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.689997 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.690144 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.690291 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.690432 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.690579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.690735 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.690883 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.691024 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.691191 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.691395 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.691564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.691720 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.691861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.692020 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.692302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.692451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.692599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.692749 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.692896 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.693038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.693178 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 22:42:23.693330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.693479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.693697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.693842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.693990 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.694130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.694368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.694611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.694845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.695001 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.695146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.695146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.695434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.695434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.695816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.695958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.696105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.696246 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.696386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.696535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.696683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.696831 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.696972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.697118 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.697266 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.697425 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.697592 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.697748 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.697896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.698043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.698197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.698345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.698642 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.699040 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.699199 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.699359 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.699512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.699653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.699794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.699932 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.700079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.700230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.700386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.700525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.700665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.700804 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.700952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.701100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.701259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.701399 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.701547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.701547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.702153 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.702433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.702588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.702588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.702868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.703023 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.703173 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.703321 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.703472 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.703618 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.703759 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.703909 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.704049 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.704196 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.704363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.704363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.704837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.705072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.705218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.705368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.705508 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.705845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.705991 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.706144 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.706284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.706424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.706564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.706710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.706904 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.707117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.707276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.707417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.707564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.707711 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.707876 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.708018 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.708157 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.708304 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.708451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.708591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.708743 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.708891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.709033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.709173 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.709320 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.709461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.709631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.709631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.709929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.710078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.710220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.710372 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.710521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.710669 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.710808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.710947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711094 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711243 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711693 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711978 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.711978 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.712254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.712254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.712692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.712836 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.712975 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.712975 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.713251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.713763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.713923 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.714065 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.714219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.714434 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.714605 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.714841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.715104 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.715408 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.715579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.715725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.715965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.716111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.716259 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.716412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.716561 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.716713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.716860 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.717001 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.717147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.717288 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.717516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.717721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.717864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.718015 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.718330 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.718492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.718647 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.718794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.718934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.719074 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.719212 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.719212 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.719495 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.719495 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.719764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.719911 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.720051 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.720204 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.720404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.720552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.720693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.720833 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.720971 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.721119 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.721266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.721413 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.721637 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.721786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.721944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.722086 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.722225 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.722376 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.722778 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.723051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.723239 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.723456 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.723623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.723768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.723909 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.724050 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.724198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.724346 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.724494 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.724635 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.724811 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.725041 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.725315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.725315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.725709 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.725861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726792 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726932 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.726932 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.727219 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.727367 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.727514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.727662 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.727662 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.727939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.727939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.728206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.728354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.728503 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.728650 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.728813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.728813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.729090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.729229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.729369 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.729517 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.729681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.729823 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.730085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.730243 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.730384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.730523 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.730662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.730813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.730953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.731107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.731247 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.731387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.731526 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.731673 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.731821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.731981 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.732129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.732277 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.732424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.732563 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.732885 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.732885 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.733176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.733333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.733488 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.733685 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.733837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.733986 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.734133 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.734274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.734413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.734552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.734704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.734855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.737830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.738005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.738203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.738416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.738583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.738737 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.738879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.739038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.739186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.739337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.739486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.739627 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.739786 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.739926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.740065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.740218 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.740359 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.740508 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.740655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.740802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.740950 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.741103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.741250 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.741390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.741634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.741794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.741934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.742083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.742223 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.742363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.742520 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.742675 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.743009 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.743161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.743311 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.743460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.743608 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.743775 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.743972 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.744115 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.744263 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.744412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.744552 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.744692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.744840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.744987 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.745134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.745275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.745414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.745611 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.745771 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.745929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.746071 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.746211 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.746350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.746498 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.746639 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.746790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.747207 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.747360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.747842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.748007 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.748151 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.748310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.748466 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.748608 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.748755 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.748906 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.749085 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.749229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.749369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.749517 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.749769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.749920 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.750074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.750239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.750393 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.750548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.750707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.750854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.751001 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.751147 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.751292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.751437 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.751668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.751818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.751963 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.752118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.752282 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.752437 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.752598 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.752762 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.753254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.753410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.753686 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.753861 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.754011 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.754159 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.754305 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.754452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.754606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.754782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.754937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.755092 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.755240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.755396 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.755542 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.755703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.755868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.756026 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.756181 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.756329 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.756482 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.756644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.756801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.756948 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.757093 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.757239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.757400 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.757549 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.758005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.758162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.758320 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.758487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.758644 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.758791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.758937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.759095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.759242 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.759390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.759639 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.759797 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.759951 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.760098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.760244 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.760390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.760546 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.760700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.760847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.761012 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.761012 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.761416 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.761586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.761739 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.761898 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.762045 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.762191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.762191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.762480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.762784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.762951 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.763101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.763406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.763582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.763731 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.763877 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.764033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.764180 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.764325 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.764481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.764638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.764787 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.764941 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.765088 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.765337 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.765515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.765699 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.765864 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.766027 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.766176 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.766322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.766786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.766944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.767100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.767260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.767417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.767417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.767707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.768314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.768480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.768639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.768788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.768935 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.769089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.769236 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.769453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.769713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.769878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.770034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.770192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.770192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.770495 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.770653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.770801 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.770801 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.771096 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.771245 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.771404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.771552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.771710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.771865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.772019 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.772174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.772341 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.772489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.772643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.772791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.772937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.773098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.773246 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.773538 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.773725 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.773882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.774029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.774185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.774340 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.774500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.774654 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.774810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.774957 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.775115 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.775269 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.775269 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.775565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.775711 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.775864 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776024 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776332 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776485 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776485 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776973 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.776973 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.777269 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.777417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.777589 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.777754 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.777902 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.778167 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.778554 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.778725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.778873 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.779029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.779183 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.779339 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.779486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.779639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.779792 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.779953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.780101 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.780255 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.780413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.780560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.780734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.780883 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.781029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.781183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.781331 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.781478 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.781665 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.781824 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.782081 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.782256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.782414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.782563 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.782718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.782886 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.783046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.783194 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.783353 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.783649 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.783817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.783966 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.784112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.784259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.784405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.784566 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.784724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.784884 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.785099 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.785287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.785445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.785625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.785779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.785936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.786083 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.786229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.786375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.786533 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.786689 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.786836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.786993 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.787140 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.787285 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.787442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.787589 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.787738 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.787891 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.788038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.788285 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.788757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.788917 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.789064 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.789218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.789385 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.789692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.789850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.790006 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.790161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.790315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.790469 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.790630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.790778 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.791124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.791124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.791433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.791589 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.791767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.791767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.792057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.792210 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.792357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.792651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.793038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.793200 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.793435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.793623 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.793958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.794126 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.794275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.794435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.794583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.794731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.794885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.795049 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.795204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.795352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.795507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.795663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.795817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.795989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.796147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.796313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.796462 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.796610 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.796770 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.796926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.797073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.797221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.797376 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.797524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.797524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.797845 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.797992 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.798138 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.798314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.798719 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.798997 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.799159 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.799315 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.799471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.799627 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.799775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.799930 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.800087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.800235 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.800382 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.800529 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.800696 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.800852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.800999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.801153 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.801301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.801456 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.801683 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.801845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.801995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.802148 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.802305 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.802454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.802609 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.802768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.802929 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.803086 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.803255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.803412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.803566 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.803715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.803887 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.804580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.804827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.804949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.805067 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.805177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.805285 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.805393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.805517 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.805949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.806117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.806267 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.806445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.806609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.806766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.806943 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.807104 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.807253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.807412 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.807568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.807718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.807865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.808042 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.808203 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.808436 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.808860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.809178 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.809342 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.809491 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.809758 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.809758 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.810072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.810220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.810375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.810522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.810668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.810829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.810984 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.811132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.811132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.811419 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.811573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.811734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.811883 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.812050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.812197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.812350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.812497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.812653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.812801 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.812955 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.813103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.813256 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.813411 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.813753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.814741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.814966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.815126 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.815282 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.815440 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.815682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.815840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.816003 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.816156 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.816310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.816466 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.816613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.816613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.816919 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.817077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.817232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.817384 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.817530 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.817714 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.817872 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.818021 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.818168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.818168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.818619 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.819062 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.819350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.819506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.819662 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.819817 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.819964 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.820121 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.820279 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.820476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.820626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.820781 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.820929 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.821090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.821251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.821406 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.821624 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.821780 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.821940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.822089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.822236 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.822383 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.822536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.822691 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.822691 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.823066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.823221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.823386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.823386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.823774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.823934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.824082 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.824401 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.824569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.824569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.824872 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.825023 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.825169 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.825322 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.825483 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.825653 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.825816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.825964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.826121 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.826270 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.826270 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.826552 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.826712 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.826867 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827488 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827740 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827824 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.827914 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828191 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828276 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828367 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828611 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828683 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.828853 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.829187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.829276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.829367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.829455 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.829542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.829813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.829911 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830170 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830247 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830319 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830584 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830851 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.830943 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831460 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831460 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831620 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831712 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831795 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831946 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.831946 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.832205 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.832366 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.832506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.832659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.832790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.832885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.832970 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833136 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833226 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833321 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833792 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833878 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.833961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834333 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834593 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834776 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.834946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835134 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835399 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835584 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835770 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.835943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836129 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836379 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836461 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836557 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836647 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.836986 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837162 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837245 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837334 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837499 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837691 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837787 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837879 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.837969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838141 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.838799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.839945 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840138 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840223 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840321 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840321 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840476 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840735 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.840985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841071 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841154 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841420 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841633 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.841937 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842056 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842056 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842204 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842439 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842510 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842658 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842736 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842819 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842891 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.842960 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843037 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843113 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843197 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843270 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843347 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843509 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843599 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843695 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843779 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.843951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844041 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844394 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844609 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844709 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844802 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.844976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845059 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845240 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845407 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845712 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845903 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.845987 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846436 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846520 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846520 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846677 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846853 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.846985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847423 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847599 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847689 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.847814 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.848268 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.848362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.848446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.848532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.848623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.848732 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.848867 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849001 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849149 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849258 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849341 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849413 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849885 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.849885 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850069 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850166 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850250 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850424 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850607 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.850955 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851044 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851227 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851475 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851821 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.851970 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852049 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852132 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852215 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852383 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852744 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.852982 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.853060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.853132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.853132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.853273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.853356 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.853732 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.853967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.854274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.854359 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.854579 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.854674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.854920 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.855062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.855245 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.855402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.855551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.855731 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.855862 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.856051 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.856175 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.856385 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.856467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.856701 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.856782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.857014 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.857135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.857427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.857710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.857801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.857893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.857978 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.858076 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.858288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.858385 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.858590 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.858690 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.858905 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.858998 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.859215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.859322 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.859537 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.859685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.859843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.859940 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.860163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.860283 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.860479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.860571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.860788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.861124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.861434 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.861772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.861882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.862190 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.862286 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.862512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.862693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.862896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.863043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.863135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.863396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.863493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.863760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.863872 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.864067 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.864160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.864393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.864504 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.864711 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.864803 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.865033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.865134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.865363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.865471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.865683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.865832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.866015 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.866149 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.866334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.866471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.866646 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.866831 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.866955 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.867182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.867292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.867479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.867572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.867789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.867882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.868117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.868223 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.868471 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.868603 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.868791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.868903 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.869105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.869213 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.869434 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.869574 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.869788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.869900 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.870097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.870220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.870426 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.870769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.870864 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.871109 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.871217 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.871419 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.871510 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.871758 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.871857 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.872083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.872186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.872390 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.872483 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.872702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.872810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.873006 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.873112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.873234 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 22:42:23.873327 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.873653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.873987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.874298 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.874613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.874926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.875235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.875545 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.875854 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.876164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.876471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.876781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.877090 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.877398 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.877736 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.878054 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.878395 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.878756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.879182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.879499 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.879823 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.880141 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.880450 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.880759 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.881066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.881411 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.881764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.882080 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.882384 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.882818 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.883130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.883449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.883773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.884085 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.884406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.884728 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.885102 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.885424 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.885781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.886110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.886611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.886950 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.887278 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.887585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.887891 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.888199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.888510 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.888851 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.889164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.889467 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.889795 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.890107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.890411 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.890718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.891023 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.891327 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.891634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.891934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.892236 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.892539 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.892841 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.893142 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.893469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.893801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.894105 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.894408 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.894708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.895011 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.895311 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.895640 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.895973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.896288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.896607 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.896922 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.897240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.897547 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.897910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.898229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.898546 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.898860 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.899194 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.899502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.899810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.900143 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.900450 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.900756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.901063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.901388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.901737 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.902087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.902410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.902728 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.903069 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.903380 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.903688 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.904013 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.904322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.904631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.904937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.905246 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.905587 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.905896 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.906205 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.906514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.906828 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.907138 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.907486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.907808 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.908116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.908440 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.908760 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.909113 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.909423 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.909791 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.910237 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.910552 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.910864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.911169 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 22:42:23.911413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 22:42:23.933894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Registered counter for database nova_api Aug 01 22:42:23.954410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:23.961388 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:23.973987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO dbcounter [None req-befcba52-92b5-4353-8620-66667baad605 None None] Registered counter for database nova_api Aug 01 22:42:23.994397 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_db.sqlalchemy.engines [None req-befcba52-92b5-4353-8620-66667baad605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:24.002330 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writer thread running {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:24.017404 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.context [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794832fa-2d4b-444b-8427-3666cab1df17(cell1) {{(pid=124358) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 22:42:24.021633 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:42:24.023242 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:42:24.024029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:42:24.026063 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:42:24.028136 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Registered counter for database nova_cell0 Aug 01 22:42:24.032138 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Registered counter for database nova_cell1 Aug 01 22:42:24.039397 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:24.041622 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:24.046582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:24.051764 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:24.059429 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.context [None req-befcba52-92b5-4353-8620-66667baad605 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794832fa-2d4b-444b-8427-3666cab1df17(cell1) {{(pid=124356) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 22:42:24.063768 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-befcba52-92b5-4353-8620-66667baad605 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:42:24.065383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-befcba52-92b5-4353-8620-66667baad605 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:42:24.066274 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-befcba52-92b5-4353-8620-66667baad605 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:42:24.068267 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-befcba52-92b5-4353-8620-66667baad605 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:42:24.070296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO dbcounter [None req-befcba52-92b5-4353-8620-66667baad605 None None] Registered counter for database nova_cell0 Aug 01 22:42:24.074306 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO dbcounter [None req-befcba52-92b5-4353-8620-66667baad605 None None] Registered counter for database nova_cell1 Aug 01 22:42:24.081937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_db.sqlalchemy.engines [None req-befcba52-92b5-4353-8620-66667baad605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:24.084093 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_db.sqlalchemy.engines [None req-befcba52-92b5-4353-8620-66667baad605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:24.090278 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writer thread running {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:24.091603 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writer thread running {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:24.199176 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Registered counter for database nova_cell0 Aug 01 22:42:24.208135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:24.213017 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:24.238336 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO dbcounter [None req-befcba52-92b5-4353-8620-66667baad605 None None] Registered counter for database nova_cell0 Aug 01 22:42:24.245335 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_db.sqlalchemy.engines [None req-befcba52-92b5-4353-8620-66667baad605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 22:42:24.250599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writer thread running {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 22:42:24.522534 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:42:24.529901 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:42:24.562270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: WARNING keystonemiddleware.auth_token [None req-befcba52-92b5-4353-8620-66667baad605 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:42:24.569797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: WARNING keystonemiddleware.auth_token [None req-befcba52-92b5-4353-8620-66667baad605 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:42:24.875464 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:42:24.881435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-f25f92ef-8fd6-42ee-a339-4baf7f45b719 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:42:24.886830 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556fdaec49c0 pid: 124358 (default app) Aug 01 22:42:24.912969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: WARNING keystonemiddleware.auth_token [None req-befcba52-92b5-4353-8620-66667baad605 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 22:42:24.919043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: WARNING keystonemiddleware.auth_token [None req-befcba52-92b5-4353-8620-66667baad605 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 22:42:24.924383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556fdaec49c0 pid: 124356 (default app) Aug 01 22:43:06.589219 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:06.593391 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:06.594823 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:06.596250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:08.142071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9d55cee2-2569-416d-9b43-53af066c234f tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Action: 'create', calling method: .version_select at 0x7fc5438c9ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1104137298"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:10.938867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9d55cee2-2569-416d-9b43-53af066c234f tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.361641 Aug 01 22:43:10.940461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Aug 1 22:43:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4365 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 22:43:11.487435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-64d9abd8-ae0b-444f-8053-fe7fc27896ae tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc5439a6a60>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:11.524131 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:11.526076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:11.527498 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:11.528443 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:12.302824 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-64d9abd8-ae0b-444f-8053-fe7fc27896ae tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9" status: 200 len: 346 microversion: 2.1 time: 1.350727 Aug 01 22:43:12.303991 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 1/2] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:43:10 2022] GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 => generated 346 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:12.327019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e1f58e0c-adb8-49da-a125-e645f8962154 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Action: 'create', calling method: .version_select at 0x7fc54374cca0>, body: {"snapshot": {"volume_id": "e927866e-7446-4ba8-bffe-9e5569b881b9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-883800499"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:13.147899 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e1f58e0c-adb8-49da-a125-e645f8962154 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.832962 Aug 01 22:43:13.148572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1162 bytes} [Mon Aug 1 22:43:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:43:13.160174 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a894e73e-c98a-48cd-839c-e9b6bffeb343 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc5437fad30>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:14.346625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a894e73e-c98a-48cd-839c-e9b6bffeb343 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 200 len: 286 microversion: 2.1 time: 1.190678 Aug 01 22:43:14.348375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 1 22:43:13 2022] GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 286 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:14.359876 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7db03d2d-485c-4363-b5f6-2959d837e3a9 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc54375de50>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:14.490135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7db03d2d-485c-4363-b5f6-2959d837e3a9 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.133072 Aug 01 22:43:14.490135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1140 bytes} [Mon Aug 1 22:43:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:14.500100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-13984811-969e-4e84-be44-23d313242ddb tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc5437fac10>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:14.606844 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-13984811-969e-4e84-be44-23d313242ddb tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 200 len: 286 microversion: 2.1 time: 0.104907 Aug 01 22:43:14.607548 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 1 22:43:14 2022] GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:15.624741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-690b2006-b2bd-41e3-af85-6c6e9d9bbda8 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc54375dca0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:15.688097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-690b2006-b2bd-41e3-af85-6c6e9d9bbda8 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 200 len: 286 microversion: 2.1 time: 0.072310 Aug 01 22:43:15.693808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 1 22:43:15 2022] GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:16.701082 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a0fadaa4-25ce-4967-b08d-9e2439b5605d tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc543743550>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:16.802670 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a0fadaa4-25ce-4967-b08d-9e2439b5605d tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 200 len: 286 microversion: 2.1 time: 0.105869 Aug 01 22:43:16.808264 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 1 22:43:16 2022] GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:17.634017 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1804483869", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:17.815991 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-204919a9-1a9b-470d-9468-1e6de18f638f tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc543743c10>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:17.953817 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] validate_networks() for [('5bee37cf-5a4d-4797-a16f-d959b4b59227', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:43:17.966255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-204919a9-1a9b-470d-9468-1e6de18f638f tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 200 len: 287 microversion: 2.1 time: 0.154062 Aug 01 22:43:17.973845 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 5/9] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 1 22:43:17 2022] GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:43:17.981924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d06f5e1c-49cc-40d9-82ca-2f9d61511083 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc543743b80>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:18.270110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d06f5e1c-49cc-40d9-82ca-2f9d61511083 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 202 len: 0 microversion: 2.1 time: 0.294577 Aug 01 22:43:18.276657 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 6/10] 10.222.0.47 () {58 vars in 1254 bytes} [Mon Aug 1 22:43:17 2022] DELETE /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:43:18.283723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0baa58e6-fd05-4457-bf70-160bcdb2214f tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc5437434c0>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:18.629274 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0baa58e6-fd05-4457-bf70-160bcdb2214f tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 200 len: 286 microversion: 2.1 time: 0.347714 Aug 01 22:43:18.633721 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 7/11] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 1 22:43:18 2022] GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 286 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:19.649335 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5003d4ce-c325-4bea-af8d-d113cb9ef3a9 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc5437fab80>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:19.783622 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-5003d4ce-c325-4bea-af8d-d113cb9ef3a9 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] HTTP exception thrown: Snapshot 699b56dd-8522-4e58-9939-4deacaf1c0fd could not be found. Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5003d4ce-c325-4bea-af8d-d113cb9ef3a9 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Request method failure captured: Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd HTTP/1.1 Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fb64q1LHBJGOuVqn5olyB0BjSHtqzHWvIkLbqOU5r3RJzlhA7ErXzGAf2sVBcX9uGq6_p5VXcSsH2ydZa6iK_Vtvtj4yGFh7v74HR4YjtBQY9yr9WvM1zyk596Tk8ZqjozTAkgimiLEMlZCXQTjsNaoGkytKj9eAu6tkCz7HO4jIDc Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:43:19.789188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fcf1ca7cb1194e0ca37da94225a1e139", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 8f6f6e5693dc4f0aa985b6313b6ffcbe Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Snapshot 699b56dd-8522-4e58-9939-4deacaf1c0fd could not be found. Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '699b56dd-8522-4e58-9939-4deacaf1c0fd'} Aug 01 22:43:19.790801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 699b56dd-8522-4e58-9939-4deacaf1c0fd could not be found. (HTTP 404) (Request-ID: req-3ccdd954-9a00-4724-b91a-9eb5ffc4d600) Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:19.791775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:43:19.792842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 699b56dd-8522-4e58-9939-4deacaf1c0fd could not be found. Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 22:43:19.793864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 699b56dd-8522-4e58-9939-4deacaf1c0fd could not be found. Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 699b56dd-8522-4e58-9939-4deacaf1c0fd could not be found. Aug 01 22:43:19.794965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:19.798159 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5003d4ce-c325-4bea-af8d-d113cb9ef3a9 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Returning 404 to user: Snapshot 699b56dd-8522-4e58-9939-4deacaf1c0fd could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:43:19.801861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5003d4ce-c325-4bea-af8d-d113cb9ef3a9 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd" status: 404 len: 111 microversion: 2.1 time: 0.158381 Aug 01 22:43:19.807905 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 8/12] 10.222.0.47 () {58 vars in 1251 bytes} [Mon Aug 1 22:43:19 2022] GET /compute/v2.1/os-snapshots/699b56dd-8522-4e58-9939-4deacaf1c0fd => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:43:19.821934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e8e3e208-4885-4f21-bf92-017b788bb74e tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc543726790>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:19.960275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e8e3e208-4885-4f21-bf92-017b788bb74e tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9" status: 202 len: 0 microversion: 2.1 time: 0.149599 Aug 01 22:43:19.965961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 9/13] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:43:19 2022] DELETE /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:43:19.974836 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1756837a-02b4-4b73-b4f7-c225ecc3211c tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc543726e50>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:20.069345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1756837a-02b4-4b73-b4f7-c225ecc3211c tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9" status: 200 len: 345 microversion: 2.1 time: 0.101887 Aug 01 22:43:20.070898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 10/14] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:43:19 2022] GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:20.251788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-564726323", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "networks": [{"uuid": "89a5e2a6-df34-4e10-9a9c-e6edc4269536"}]}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:20.431703 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] validate_networks() for [('89a5e2a6-df34-4e10-9a9c-e6edc4269536', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:43:21.441309 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:43:21.442077 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:43:21.442236 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:43:21.442960 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:43:21.443741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:43:21.483702 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:21.484146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:21.502647 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:21.503095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:21.578616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for project 6a6afb01194249d6af1c369e9f109b72. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:43:21.589488 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for user a8bbeb0e65a54b1199d0fe718168af70 and project 6a6afb01194249d6af1c369e9f109b72. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:43:21.611507 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:43:21.615310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:43:21.855738 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0dbb8b83-9084-4a99-8bf1-861f6a4e9dfc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.323521 Aug 01 22:43:21.874041 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 5/15] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:43:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:43:21.879907 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e627c0dc-722e-4c0a-b667-78d31fdca5bc tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc5436649d0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:22.048612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e627c0dc-722e-4c0a-b667-78d31fdca5bc tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9" status: 200 len: 345 microversion: 2.1 time: 0.172899 Aug 01 22:43:22.049832 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 6/16] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:43:21 2022] GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 => generated 345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:22.055501 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-32a7188a-cf5c-41b4-a749-1190de674aac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:22.056145 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-32a7188a-cf5c-41b4-a749-1190de674aac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:22.286117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:43:22.286848 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:43:22.287280 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:43:22.287700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:43:22.288161 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:43:22.325996 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:22.326937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:22.329130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:22.329852 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:22.416209 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Getting quotas for project 41e72072c5cc453fbc31425b050a07c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:43:22.433149 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Getting quotas for user a2ff5f41f9b44c2c9f5f90f13c266fbd and project 41e72072c5cc453fbc31425b050a07c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:43:22.491381 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:43:22.504315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:43:22.551306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-32a7188a-cf5c-41b4-a749-1190de674aac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:22.607929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-32a7188a-cf5c-41b4-a749-1190de674aac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1222 microversion: 2.1 time: 0.556778 Aug 01 22:43:22.608526 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 7/17] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:22 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1222 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:22.763860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-95c31634-b4ca-4ced-accd-9ba0227cc28b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'create', calling method: .version_select at 0x7fc5436648b0>, body: {"keypair": {"name": "tempest-keypair-1713754797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQc1OFmQ7GH95OCW3ZutXhL3dDRvVs5l283vK5QM/RUNLM8VwCUbP4Y/JcG9IwMEBjATrT2wgihbzzxoP1vnOxvjBSeFP43pl+arr1vh5y4WI7rGC52xezNqTKZD122LQ=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:22.778529 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0432dee6-a1b4-4cd8-a143-0c14479b5ba8 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.678622 Aug 01 22:43:22.787486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 11/18] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 22:43:22.794794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-95c31634-b4ca-4ced-accd-9ba0227cc28b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:43:22.799543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-95c31634-b4ca-4ced-accd-9ba0227cc28b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for user e6d336332a65408c8a438c8f96f4415d and project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:43:22.810868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1145396341", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:22.867685 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-95c31634-b4ca-4ced-accd-9ba0227cc28b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.258043 Aug 01 22:43:22.872998 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 8/19] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:43:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:22.893953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8ca84b08-836f-4593-ab18-b3de6cee7891 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:22.898323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8ca84b08-836f-4593-ab18-b3de6cee7891 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:23.033598 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] validate_networks() for [('5bee37cf-5a4d-4797-a16f-d959b4b59227', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:43:23.144401 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8ca84b08-836f-4593-ab18-b3de6cee7891 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:23.157476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8ca84b08-836f-4593-ab18-b3de6cee7891 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1214 microversion: 2.1 time: 0.280066 Aug 01 22:43:23.178066 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 9/20] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:22 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:23.189265 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-057dd45f-7e90-4b63-85d4-ff8858e4fdf2 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc54262a5e0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:24.422711 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:43:24.423480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:43:24.423649 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:43:24.424217 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:43:24.424638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:43:24.461459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:24.461918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:24.462700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:24.463185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:24.529482 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for project 6a6afb01194249d6af1c369e9f109b72. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:43:24.545453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for user a8bbeb0e65a54b1199d0fe718168af70 and project 6a6afb01194249d6af1c369e9f109b72. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:43:24.599698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-057dd45f-7e90-4b63-85d4-ff8858e4fdf2 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] HTTP exception thrown: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-057dd45f-7e90-4b63-85d4-ff8858e4fdf2 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Request method failure captured: Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 HTTP/1.1 Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6Fb64q1LHBJGOuVqn5olyB0BjSHtqzHWvIkLbqOU5r3RJzlhA7ErXzGAf2sVBcX9uGq6_p5VXcSsH2ydZa6iK_Vtvtj4yGFh7v74HR4YjtBQY9yr9WvM1zyk596Tk8ZqjozTAkgimiLEMlZCXQTjsNaoGkytKj9eAu6tkCz7HO4jIDc Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:43:24.606651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fcf1ca7cb1194e0ca37da94225a1e139", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 8f6f6e5693dc4f0aa985b6313b6ffcbe Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'e927866e-7446-4ba8-bffe-9e5569b881b9'} Aug 01 22:43:24.607900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. (HTTP 404) (Request-ID: req-1c02c23a-344c-4eac-99b2-9720077345f2) Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:24.609161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:43:24.610542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 22:43:24.611571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:24.612442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:24.615905 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-057dd45f-7e90-4b63-85d4-ff8858e4fdf2 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Returning 404 to user: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:43:24.620504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-057dd45f-7e90-4b63-85d4-ff8858e4fdf2 tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9" status: 404 len: 109 microversion: 2.1 time: 1.438557 Aug 01 22:43:24.633410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 10/21] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:43:23 2022] GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 => generated 109 bytes in 1455 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:43:24.649641 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:43:24.660837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:43:24.824119 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f22b6182-1cc5-4797-9736-af946d67f931 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.034575 Aug 01 22:43:24.834261 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 12/22] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:43:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:43:24.852802 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:24.853515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:24.877827 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b581b1e7-0967-4b8a-b4c6-634ba883ef62 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'create', calling method: .version_select at 0x7fc5440d13a0>, body: {"keypair": {"name": "tempest-keypair-997371231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW8Xl/7F/91sfbtOcArbKgVaUtbysq0taZ5H/4EYFdhKcXGUy2p+2/xlPPQ21Bwi45yJCnSb0cLan6HwO2Y3OXaPhlBwZfhyFCxSNtBHANjGb9TTUa0N7s4RanFnhS2lw=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:24.926074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:24.927136 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:24.928124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:24.928997 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:24.977791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-b581b1e7-0967-4b8a-b4c6-634ba883ef62 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for project 96cf343ab1cd4658997298d18a083f29. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:43:24.998944 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-b581b1e7-0967-4b8a-b4c6-634ba883ef62 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for user 527b7873931742049db9f44104396686 and project 96cf343ab1cd4658997298d18a083f29. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:43:25.151979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b581b1e7-0967-4b8a-b4c6-634ba883ef62 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.516417 Aug 01 22:43:25.174963 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 11/23] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 1 22:43:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 540 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 22:43:25.222068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2521e1a2-69d6-488b-8e7f-efbc494a9e3e tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc541dc7940>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:25.430632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-2521e1a2-69d6-488b-8e7f-efbc494a9e3e tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] HTTP exception thrown: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2521e1a2-69d6-488b-8e7f-efbc494a9e3e tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Request method failure captured: Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 HTTP/1.1 Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6Fb64q1LHBJGOuVqn5olyB0BjSHtqzHWvIkLbqOU5r3RJzlhA7ErXzGAf2sVBcX9uGq6_p5VXcSsH2ydZa6iK_Vtvtj4yGFh7v74HR4YjtBQY9yr9WvM1zyk596Tk8ZqjozTAkgimiLEMlZCXQTjsNaoGkytKj9eAu6tkCz7HO4jIDc Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:43:25.433372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fcf1ca7cb1194e0ca37da94225a1e139", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 8f6f6e5693dc4f0aa985b6313b6ffcbe Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'e927866e-7446-4ba8-bffe-9e5569b881b9'} Aug 01 22:43:25.434700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. (HTTP 404) (Request-ID: req-8b4fcf5a-4896-46b7-8564-bb9510c072e5) Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:25.435551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 22:43:25.436660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 22:43:25.442686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2521e1a2-69d6-488b-8e7f-efbc494a9e3e tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Returning 404 to user: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2521e1a2-69d6-488b-8e7f-efbc494a9e3e tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9" status: 404 len: 109 microversion: 2.1 time: 0.259053 Aug 01 22:43:25.443713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:43:25 2022] DELETE /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 => generated 109 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:43:25.472926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-67b43df1-f763-4a99-99f0-9c96bbe8594d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:25.473905 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-67b43df1-f763-4a99-99f0-9c96bbe8594d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:25.519173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:25.548816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1358a073-15f4-42cb-9d79-574dff3ec396 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1218 microversion: 2.1 time: 0.712993 Aug 01 22:43:25.565839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:24 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1218 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:25.580934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f18783d8-b284-432f-a06a-54375beeccce tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Calling method '.version_select at 0x7fc542dd3430>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:25.850300 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-67b43df1-f763-4a99-99f0-9c96bbe8594d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:25.868655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-f18783d8-b284-432f-a06a-54375beeccce tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] HTTP exception thrown: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f18783d8-b284-432f-a06a-54375beeccce tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Request method failure captured: Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 HTTP/1.1 Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fb64q1LHBJGOuVqn5olyB0BjSHtqzHWvIkLbqOU5r3RJzlhA7ErXzGAf2sVBcX9uGq6_p5VXcSsH2ydZa6iK_Vtvtj4yGFh7v74HR4YjtBQY9yr9WvM1zyk596Tk8ZqjozTAkgimiLEMlZCXQTjsNaoGkytKj9eAu6tkCz7HO4jIDc Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:43:25.874210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fcf1ca7cb1194e0ca37da94225a1e139", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fcf1ca7cb1194e0ca37da94225a1e139"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: fcf1ca7cb1194e0ca37da94225a1e139 Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-701024705 Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 8f6f6e5693dc4f0aa985b6313b6ffcbe Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesSnapshotsTestJSON-701024705-project Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'e927866e-7446-4ba8-bffe-9e5569b881b9'} Aug 01 22:43:25.875630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. (HTTP 404) (Request-ID: req-26f524b7-c211-41dc-875c-9559d9188ba3) Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:25.876414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:43:25.877507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 22:43:25.878693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. Aug 01 22:43:25.880727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:43:25.881617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f18783d8-b284-432f-a06a-54375beeccce tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] Returning 404 to user: Volume e927866e-7446-4ba8-bffe-9e5569b881b9 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:43:25.883110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f18783d8-b284-432f-a06a-54375beeccce tempest-VolumesSnapshotsTestJSON-701024705 tempest-VolumesSnapshotsTestJSON-701024705-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9" status: 404 len: 109 microversion: 2.1 time: 0.314830 Aug 01 22:43:25.891027 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 14/26] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:43:25 2022] GET /compute/v2.1/os-volumes/e927866e-7446-4ba8-bffe-9e5569b881b9 => generated 109 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:43:25.892557 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-67b43df1-f763-4a99-99f0-9c96bbe8594d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1222 microversion: 2.1 time: 0.454175 Aug 01 22:43:25.908711 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 13/27] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:25 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1222 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:26.573431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:26.574795 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:26.591264 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:26.594426 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:26.595558 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:26.596941 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:26.805492 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:26.829952 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-078420fb-ecf1-46d3-b032-3f97c35a0e2d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1266 microversion: 2.1 time: 0.260993 Aug 01 22:43:26.832457 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 15/28] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:26 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:26.927249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:26.928475 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:26.940629 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:26.943038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:26.946963 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:26.947814 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:27.859361 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:27.860172 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:27.870631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:27.874431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:27.877395 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:27.880940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:28.034946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:28.066879 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c3d88a27-545f-4945-bade-63f09cae2e62 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1226 microversion: 2.1 time: 1.144109 Aug 01 22:43:28.091364 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 14/29] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:26 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1226 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:28.230578 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:28.287405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e33a2584-4bd6-4428-aede-4ee0a2ac83d1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1272 microversion: 2.1 time: 0.426474 Aug 01 22:43:28.299482 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 16/30] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:27 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1272 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:29.104518 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:29.106311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:29.119593 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:29.120140 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:29.120958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:29.121400 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:29.328196 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:29.329480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:29.390667 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:29.393873 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:29.398786 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:29.399924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:29.501277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:29.545006 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c0b420e2-38a5-4c71-8181-5356d8dc0fd6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1280 microversion: 2.1 time: 0.449020 Aug 01 22:43:29.545999 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 15/31] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:29 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1280 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:29.902794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:29.911917 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7d9fc4b3-d9e0-4300-8849-c1c125656d0d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1272 microversion: 2.1 time: 0.593238 Aug 01 22:43:29.925198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 17/32] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:29 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1272 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:29.930755 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1601132396", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67aba567-9102-406a-a1da-ceefe516bf22"}], "security_groups": [{"name": "tempest-securitygroup--823371493"}], "key_name": "tempest-keypair-1713754797", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:30.474796 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] validate_networks() for [('67aba567-9102-406a-a1da-ceefe516bf22', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:43:30.576359 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:30.597918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:30.626189 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:30.627396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:30.631034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:30.634463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:31.236983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:31.253487 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-36e01703-4a55-420b-b3b1-7addfa06b9d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1280 microversion: 2.1 time: 0.686922 Aug 01 22:43:31.255645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 18/33] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:30 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1280 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:31.262572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:31.263529 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:31.271438 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:31.272215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:31.273222 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:31.286898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:31.413040 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:31.438709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-61bfbece-f096-49cd-b6a3-2894cecb185b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1272 microversion: 2.1 time: 0.181067 Aug 01 22:43:31.444628 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 19/34] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:31 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:31.537815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:32.287089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:32.290164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:32.305393 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:32.312044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:32.313251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:32.316318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:33.461334 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:33.475625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-17979a8f-10d3-4a8b-a687-cacb05e109ac tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 1.201564 Aug 01 22:43:33.478936 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 20/35] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:32 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:33.486491 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:33.487591 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:33.496616 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:33.499034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:33.501801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:33.502602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:34.161612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:43:34.162137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:43:34.162794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:43:34.163301 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:43:34.163893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:43:34.191523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:34.196431 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:34.200694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:34.206138 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:34.315274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:43:34.324549 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for user e6d336332a65408c8a438c8f96f4415d and project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:43:34.384093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:43:34.393220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:43:34.510559 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=4 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:34.592828 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=12 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:34.639769 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ce08f3b2-fa02-43a5-89c8-3bc4410fdad8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.717340 Aug 01 22:43:34.641964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 16/36] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:43:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 4723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:43:34.656156 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1310600026", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68a2d697-956d-438e-999f-17541428f4b3"}], "security_groups": [{"name": "tempest-securitygroup--1835346004"}], "key_name": "tempest-keypair-997371231", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:34.984249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:35.008047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c41e6bd3-6432-4029-9161-576f324afbc3 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 1.521610 Aug 01 22:43:35.030198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 21/37] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:33 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:35.047055 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:35.056918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:35.080497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:35.081642 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:35.083704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:35.088827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:35.197023 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] validate_networks() for [('68a2d697-956d-438e-999f-17541428f4b3', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:43:35.700689 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:35.727654 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-39de5ca8-9b58-4853-bdb5-0861e4a186c1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.695806 Aug 01 22:43:35.731655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 22/38] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:35 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:35.746940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d52a1e36-751f-4f9a-90f9-d30ae5569ed9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:35.748350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d52a1e36-751f-4f9a-90f9-d30ae5569ed9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:36.106638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d52a1e36-751f-4f9a-90f9-d30ae5569ed9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:36.164099 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d52a1e36-751f-4f9a-90f9-d30ae5569ed9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1238 microversion: 2.1 time: 0.425988 Aug 01 22:43:36.166690 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 23/39] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:35 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1238 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:36.184380 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:36.188327 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:36.228521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:36.228998 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:36.235292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:36.235763 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:37.790082 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:37.835284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4b9a135c-2968-4029-8819-f8fa98788da2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 1.657541 Aug 01 22:43:37.841497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 24/40] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:36 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:37.893861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:37.896417 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:37.939268 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:37.943245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:37.945377 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:37.957301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:38.834169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:43:38.834807 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:43:38.835122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:43:38.835537 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:43:38.835951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:43:38.868967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:38.869433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:38.889833 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:38.890461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:38.957453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:38.975149 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-767d38ad-a294-416e-b1b4-a206205130c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 1.129689 Aug 01 22:43:38.977171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 25/41] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:37 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:38.979199 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for project 96cf343ab1cd4658997298d18a083f29. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:43:38.991965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:38.992608 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for user 527b7873931742049db9f44104396686 and project 96cf343ab1cd4658997298d18a083f29. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:43:38.993596 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:39.011435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:39.013361 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:39.014869 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:39.017318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:39.091505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:43:39.097224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:43:39.335839 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8dad474e-3755-417d-aebb-7a59d4d10c17 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.692572 Aug 01 22:43:39.344275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 17/42] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 1 22:43:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 4702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 22:43:39.601783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:39.607894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-65bdf7bd-486e-471e-80e0-1373ff4b1992 req-e192c245-e6b3-40fd-a7c6-e0eee8849f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a237f2-d506-4bb5-97f5-29ee71910664", "tag": "482790be-cff8-4536-9a9e-1eb3977a415b"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:39.615407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bd38e8ef-a517-4ede-bad1-78dcb030b1ca tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1298 microversion: 2.1 time: 0.635936 Aug 01 22:43:39.620709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 26/43] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:38 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1298 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:39.657363 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:39.660408 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:39.667192 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-65bdf7bd-486e-471e-80e0-1373ff4b1992 req-e192c245-e6b3-40fd-a7c6-e0eee8849f0a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:39.667567 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-65bdf7bd-486e-471e-80e0-1373ff4b1992 req-e192c245-e6b3-40fd-a7c6-e0eee8849f0a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:39.695722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:39.699008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:39.701592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:39.705600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:39.752543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-65bdf7bd-486e-471e-80e0-1373ff4b1992 req-e192c245-e6b3-40fd-a7c6-e0eee8849f0a service nova] Creating event network-changed:482790be-cff8-4536-9a9e-1eb3977a415b for instance 80a237f2-d506-4bb5-97f5-29ee71910664 on hv-cinder-85164 Aug 01 22:43:39.753399 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-65bdf7bd-486e-471e-80e0-1373ff4b1992 req-e192c245-e6b3-40fd-a7c6-e0eee8849f0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 22:43:39.763011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d93a3a9-c7c1-4329-a5c5-86be5ace9630 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:39.763416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d93a3a9-c7c1-4329-a5c5-86be5ace9630 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:39.768077 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d93a3a9-c7c1-4329-a5c5-86be5ace9630 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:39.768887 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d93a3a9-c7c1-4329-a5c5-86be5ace9630 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:39.801168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.compute.rpcapi [None req-2d93a3a9-c7c1-4329-a5c5-86be5ace9630 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 22:43:39.806566 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d93a3a9-c7c1-4329-a5c5-86be5ace9630 None None] Releasing lock "compute-rpcapi-router" {{(pid=124358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 22:43:39.875994 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2d93a3a9-c7c1-4329-a5c5-86be5ace9630 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.517318 Aug 01 22:43:39.877154 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 18/44] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:39.884207 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aba926a5-4f0a-4f80-9cb3-47bbcba10ef8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:39.889287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aba926a5-4f0a-4f80-9cb3-47bbcba10ef8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:40.824025 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aba926a5-4f0a-4f80-9cb3-47bbcba10ef8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:40.850373 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aba926a5-4f0a-4f80-9cb3-47bbcba10ef8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:40.861240 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aba926a5-4f0a-4f80-9cb3-47bbcba10ef8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:40.874758 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aba926a5-4f0a-4f80-9cb3-47bbcba10ef8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1281 microversion: 2.20 time: 0.984394 Aug 01 22:43:40.894895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 19/45] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:39 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1281 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:41.513162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-ff847e52-8a23-46bd-886e-a9d353a77f90 req-f82fcf76-c1bb-4f30-a871-7a59a9e5df15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8c6c53e-256e-456b-abfc-cc69f4edfa2d", "tag": "5812ef14-fc5f-480a-9e1a-2c12b936b237"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:41.527730 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:41.544847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:41.550205 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ff847e52-8a23-46bd-886e-a9d353a77f90 req-f82fcf76-c1bb-4f30-a871-7a59a9e5df15 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:41.552592 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ff847e52-8a23-46bd-886e-a9d353a77f90 req-f82fcf76-c1bb-4f30-a871-7a59a9e5df15 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:41.580669 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bd4663a1-8736-47ed-96f5-537875aff86d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 1.947506 Aug 01 22:43:41.597279 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 27/46] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:39 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:41.614439 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-ff847e52-8a23-46bd-886e-a9d353a77f90 req-f82fcf76-c1bb-4f30-a871-7a59a9e5df15 service nova] Creating event network-changed:5812ef14-fc5f-480a-9e1a-2c12b936b237 for instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d on hv-cinder-85164 Aug 01 22:43:41.626488 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-ff847e52-8a23-46bd-886e-a9d353a77f90 req-f82fcf76-c1bb-4f30-a871-7a59a9e5df15 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.727002 Aug 01 22:43:41.627302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:41.629410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 20/47] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:41.641814 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:41.644289 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:41.644467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:41.646624 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:41.661856 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:41.665341 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:41.666951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:41.669506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:41.671643 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:41.677620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:41.684542 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:41.685073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:41.873835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:41.898320 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8ea7aa16-2505-4c23-b7df-e2b59ac0ecfe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1296 microversion: 2.1 time: 0.266648 Aug 01 22:43:41.907521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 21/48] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:41 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1296 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:41.928780 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:41.934496 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:41.956888 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:41.958301 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:41.959138 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:41.959630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:42.200520 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:42.225398 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:42.227995 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:42.236848 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-596a5ca2-ee48-4446-b7aa-8490ce46acd6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1333 microversion: 2.20 time: 0.327605 Aug 01 22:43:42.253630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 22/49] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:41 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1333 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:42.562091 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:42.571772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-87a0d5ce-704e-4e36-9a7e-ed484a815228 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.973030 Aug 01 22:43:42.580056 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 28/50] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:41 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:42.611247 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:42.612146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:42.626516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:42.629343 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:42.631662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:42.632328 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:42.934449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:42.935370 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:42.945787 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:42.946921 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:42.947962 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:42.949284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.105458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:43.115235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5b54ab72-7fbd-4c43-a2ed-dc68805be79e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1296 microversion: 2.1 time: 0.185436 Aug 01 22:43:43.119066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 29/51] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:42 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:43.146604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:43.175128 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a5a01917-aeff-4b59-9682-8562d9c1f081 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.570898 Aug 01 22:43:43.175802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 23/52] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:42 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:43.263766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:43.264730 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:43.274219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:43.275628 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.277047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:43.277656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.405045 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:43.409518 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:43.423097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:43.425093 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:43.426569 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-41e046db-0e53-43aa-be08-6c2ce03a686b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1351 microversion: 2.20 time: 0.169987 Aug 01 22:43:43.428617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 30/53] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:43 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:43:43.609894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:43.610600 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:43.622251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:43.622886 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.625366 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:43.626183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.713740 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-d7e5b563-7e94-49ab-918f-3aac6175dad1 req-777ce71e-3eed-4d2e-8d61-3c97236e1755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b370cbad-46b8-4418-9b13-b7158495237c", "tag": "f8949b0e-8028-4226-9fec-5a9262634d95"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:43.729753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-d7e5b563-7e94-49ab-918f-3aac6175dad1 req-777ce71e-3eed-4d2e-8d61-3c97236e1755 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:43.730500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-d7e5b563-7e94-49ab-918f-3aac6175dad1 req-777ce71e-3eed-4d2e-8d61-3c97236e1755 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.753643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-d7e5b563-7e94-49ab-918f-3aac6175dad1 req-777ce71e-3eed-4d2e-8d61-3c97236e1755 service nova] Creating event network-changed:f8949b0e-8028-4226-9fec-5a9262634d95 for instance b370cbad-46b8-4418-9b13-b7158495237c on hv-cinder-85164 Aug 01 22:43:43.754433 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-d7e5b563-7e94-49ab-918f-3aac6175dad1 req-777ce71e-3eed-4d2e-8d61-3c97236e1755 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124356) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 22:43:43.756856 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2f0369c2-0c36-44b7-aa6a-329576f3a140 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:43.757506 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2f0369c2-0c36-44b7-aa6a-329576f3a140 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.758478 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2f0369c2-0c36-44b7-aa6a-329576f3a140 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:43.758916 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2f0369c2-0c36-44b7-aa6a-329576f3a140 None None] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:43.780807 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.compute.rpcapi [None req-2f0369c2-0c36-44b7-aa6a-329576f3a140 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 22:43:43.781734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2f0369c2-0c36-44b7-aa6a-329576f3a140 None None] Releasing lock "compute-rpcapi-router" {{(pid=124356) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 22:43:43.823743 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2f0369c2-0c36-44b7-aa6a-329576f3a140 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114105 Aug 01 22:43:43.825031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 31/54] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:43:43.828689 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:43.841424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-61c34a54-19a7-46a5-8f26-ae84699292b5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.237393 Aug 01 22:43:43.842482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 24/55] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:43 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:44.144913 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:44.145163 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:44.166247 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.167089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:44.168024 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.168657 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:44.195627 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:44.196598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:44.207266 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.208752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:44.210630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.213073 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:44.451630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:44.452210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:44.460486 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2f2b01fa-159b-4659-83ad-7a39b2fd1ced tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.268555 Aug 01 22:43:44.461068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 25/56] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:44 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:44.467648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:44.468484 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:44.479238 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ade508ab-26de-4dc0-a677-550f2fae9d30 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.339071 Aug 01 22:43:44.480192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 32/57] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:44 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:44.494095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.494095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:44.494095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.494095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:44.581925 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:44.591222 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:44.593093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:44.595114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8ed61d2c-488a-4139-8e0e-1cc225725219 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1351 microversion: 2.20 time: 0.132088 Aug 01 22:43:44.595695 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 26/58] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:44 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:44.862860 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:44.863526 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:44.869828 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.870286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:44.871293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:44.871733 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:45.017337 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:45.025783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-589ac43b-5d1b-490f-ade1-0a144e1825dc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.166726 Aug 01 22:43:45.038872 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 33/59] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:44 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:45.486125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:45.487442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:45.495852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:45.496605 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:45.497649 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:45.498227 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:45.515398 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:45.516611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:45.537460 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:45.538324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:45.539184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:45.539652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:45.761893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:45.786459 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ff755ce3-340b-4394-9de8-9168078e1fbf tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.307160 Aug 01 22:43:45.787555 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 27/60] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:45 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:45.806470 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:45.808861 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:45.844136 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:45.847173 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:45.851148 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:45.854030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:45.910287 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:45.930563 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-03a2e0e7-ea9a-4515-8756-ee5a8c2949a2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.421661 Aug 01 22:43:45.934295 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 34/61] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:45 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:45.968998 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:45.980079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:45.981950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:45.983457 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6ae990a5-7a8d-4fb3-b31f-17e3bfa5b26f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1351 microversion: 2.20 time: 0.193621 Aug 01 22:43:45.992708 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 28/62] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:45 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:46.052458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:46.053613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:46.071526 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:46.072674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:46.075035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:46.075807 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:46.155140 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:46.326891 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:46.336442 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ed7d06df-d28f-4f00-aead-d3ad279139d9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.292926 Aug 01 22:43:46.338005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 35/63] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:46 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:46.811039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:46.811823 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:46.819469 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:46.819923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:46.820701 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:46.821137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:46.972809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:46.973445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:46.984797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:46.985818 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:46.987160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:46.987982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:46.992761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:47.019574 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4e2d06aa-6b73-4634-8c16-7a8fb3b0998a tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.214519 Aug 01 22:43:47.030920 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 29/64] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:46 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:47.041833 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:47.042885 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:47.055073 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:47.056354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:47.057633 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:47.058101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:47.138551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:47.147747 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:47.149594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:47.151065 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5b67d2ab-6d5e-4e26-b04c-4099299c3222 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1351 microversion: 2.20 time: 0.116592 Aug 01 22:43:47.167412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 30/65] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:47 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:47.183666 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:47.192053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7f332f05-a830-4c0e-b2ba-68520df3fcea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.224565 Aug 01 22:43:47.193041 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 36/66] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:46 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:47.364502 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:47.365080 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:47.372846 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:47.373339 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:47.374178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:47.374622 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:47.537400 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:47.540803 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=89 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:47.547894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-924392be-208b-4baa-8f91-39e1e7ab9ee1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.189942 Aug 01 22:43:47.548480 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 31/67] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:47 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:48.044357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:48.044943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:48.051585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.052034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:48.052803 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.053235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:48.174148 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:48.174821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:48.181292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.181776 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:48.182602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.183005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:48.194234 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:48.202238 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c5c11e66-5957-480e-8ae6-a902c54d7249 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.161891 Aug 01 22:43:48.202839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 37/68] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:48 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:48.213961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:48.215406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:48.222324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.222880 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:48.223693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.224286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:48.247657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:48.256075 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:48.257655 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:48.258755 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f6cc60b9-7b79-41f6-a26f-7810a3f63540 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1351 microversion: 2.20 time: 0.088598 Aug 01 22:43:48.259294 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 32/69] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:48 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:43:48.359679 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:48.367967 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e8b94a9f-c74e-4327-a73a-092e2490bec4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.157595 Aug 01 22:43:48.369346 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 38/70] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:48 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:48.571738 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:48.573232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:48.584089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.584799 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:48.586375 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:48.587061 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:49.221185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:49.225980 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:49.227138 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:49.230026 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2b8ab857-596b-416f-ba72-c636b503963e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.664408 Aug 01 22:43:49.235885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:49.236686 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:49.237786 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:49.238856 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:49.242671 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 33/71] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:48 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:49.287223 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:49.288713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:49.298200 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:49.298836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:49.299875 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:49.300729 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:49.394468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:49.403774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:49.405729 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:49.406815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b05f0bb2-b794-4822-8963-bc96a648feaf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1339 microversion: 2.20 time: 0.128862 Aug 01 22:43:49.407540 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 34/72] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:49 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:49.412567 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:49.413270 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:49.429395 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:49.430178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:49.431158 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:49.432261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:49.637627 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:49.649260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-01ead7c4-6109-4803-b8b4-e0e8277db632 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.240305 Aug 01 22:43:49.650331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 35/73] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:49 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:49.657674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:49.671296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8cbc6c3f-f9c0-4925-a0c9-fe6ae7941bcd tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.450923 Aug 01 22:43:49.672116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 39/74] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:49 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:50.110788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-725a69dd-a608-4c79-876f-922f9dd767ca req-0218cd7b-0344-41a9-983f-c176ab82a50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909f43f2-82b3-496f-8561-f7e7e385a275", "tag": "0314aed5-18ce-4da4-b33f-5fc8da44e112"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:50.147472 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:50.158322 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-725a69dd-a608-4c79-876f-922f9dd767ca req-0218cd7b-0344-41a9-983f-c176ab82a50d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.159261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-725a69dd-a608-4c79-876f-922f9dd767ca req-0218cd7b-0344-41a9-983f-c176ab82a50d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.194359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-725a69dd-a608-4c79-876f-922f9dd767ca req-0218cd7b-0344-41a9-983f-c176ab82a50d service nova] Creating event network-changed:0314aed5-18ce-4da4-b33f-5fc8da44e112 for instance 909f43f2-82b3-496f-8561-f7e7e385a275 on hv-cinder-85164 Aug 01 22:43:50.204589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-725a69dd-a608-4c79-876f-922f9dd767ca req-0218cd7b-0344-41a9-983f-c176ab82a50d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097105 Aug 01 22:43:50.206301 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 36/75] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:50.256255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:50.257766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:50.267926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.274067 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.274067 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.274067 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.436493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:50.437980 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:50.469054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.469836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.470907 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.474422 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.491675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:50.506071 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f716c8a0-3bd0-4541-af32-fa1c43f84015 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.257082 Aug 01 22:43:50.507013 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 40/76] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:50 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:50.678475 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:50.681487 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:50.691402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.692410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.694139 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.694735 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.721924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:50.736935 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:50.739907 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:50.741594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-178615fd-8514-4be4-a79e-d9270a07ca7b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.312053 Aug 01 22:43:50.742307 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 37/77] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:50 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:50.750677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:50.751815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:50.762632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.763798 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.765370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:50.766469 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:50.829700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=34 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:50.848996 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:50.857146 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a2a3ad04-3317-4f3b-9a6c-5c01541db762 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.185082 Aug 01 22:43:50.862497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 41/78] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:50 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:50.910808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:50.918684 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-04d7a111-1a65-49b8-b70f-ebe12527c807 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.174953 Aug 01 22:43:50.919271 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 38/79] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:50 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:51.538402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:51.539421 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:51.549042 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.549664 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:51.551104 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.551718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:51.726191 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:51.734314 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-821402cd-bbe1-4409-853e-00bd9bf4d1e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.200930 Aug 01 22:43:51.734945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 42/80] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:51 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:51.778345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:51.778991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:51.785862 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.786304 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:51.787089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.787517 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:51.878161 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:51.879043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:51.886864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.887413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:51.888207 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.888644 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:51.936491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:51.946091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:51.947604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:51.948924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4c4e4fe2-86bf-4ab8-98f8-4dddb3081498 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.174701 Aug 01 22:43:51.949504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 39/81] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:51 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:51.954521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:51.955143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:51.961903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.962369 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:51.963150 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:51.963648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:52.046096 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:52.054485 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-543cd6d8-b601-44b5-9fb1-6fac63b3ef8f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.180147 Aug 01 22:43:52.055057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 43/82] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:51 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:52.119250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:52.127855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c5e6efa0-bf70-417e-bdb5-3d34f8228a04 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.177207 Aug 01 22:43:52.128466 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 40/83] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:51 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:52.757057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:52.757828 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:52.764693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:52.765142 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:52.765966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:52.766393 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:52.915969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:52.924251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ad9472fb-6463-430d-ae3e-87d1ed0e8928 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.172396 Aug 01 22:43:52.924870 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 44/84] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:52 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:52.973123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:52.973734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:52.980806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:52.981251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:52.982080 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:52.982514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:53.077806 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:53.078442 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:53.085236 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:53.085714 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:53.086502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:53.086937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:53.127054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:53.136524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:53.138078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:53.139237 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e2a6284f-357e-410f-bc52-57a0c0ca9c39 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.170253 Aug 01 22:43:53.139836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 41/85] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:52 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:53.154128 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:53.155189 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:53.164410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:53.164861 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:53.165670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:53.166114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:53.226303 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:53.235006 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6e828546-4f8c-4ec3-aa41-35f3f2fd497d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.161664 Aug 01 22:43:53.235599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 45/86] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:53 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:53.350771 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:53.358808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c970f3f3-f18b-4e99-a9be-506e7804ab3e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.212369 Aug 01 22:43:53.359398 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 42/87] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:53 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:53.943235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:53.949788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:53.950579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:53.965008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:53.965536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:53.966501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:53.967074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:54.131593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:54.142986 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5542986d-3911-4e5b-913b-258f61c57ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.200525 Aug 01 22:43:54.144034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 46/88] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:53 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:54.162523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:54.163266 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:54.170418 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:54.170867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:54.171651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:54.172090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:54.257244 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:54.258100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:54.265715 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:54.266167 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:54.267391 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:54.267844 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:54.349505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:54.364940 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:54.367945 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:54.370077 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cd861703-0139-4b73-9c5e-8fbb1b213630 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.211321 Aug 01 22:43:54.371036 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 43/89] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:54 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:54.388554 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:54.389698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:54.400373 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:54.402129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:54.403597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:54.404382 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:54.696184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:54.708145 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4b33d1b0-1070-49bb-9472-ce2afb8e4ee2 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.330400 Aug 01 22:43:54.708818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 44/90] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:54 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:54.740570 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:54.746933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:54.755309 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bc932d07-b948-4fdd-9a6b-288fb9feb628 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.500987 Aug 01 22:43:54.756733 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 47/91] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:54 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:55.173661 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:55.174358 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:55.180921 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:55.181787 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:55.183148 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:55.183823 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:55.375973 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:55.397374 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:55.398454 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:55.399629 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-69abae01-839b-43e9-ace6-88969722211f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.230135 Aug 01 22:43:55.410369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:55.410820 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:55.411658 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:55.412359 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:55.413620 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 45/92] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:55 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:55.733842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:55.736347 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:55.753952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:55.754632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:55.756816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:55.757260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:56.183187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:56.193516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:56.199877 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4f3beeee-1b5a-41bc-a24d-2c214bfc05eb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.465966 Aug 01 22:43:56.220512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 46/93] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:55 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:56.224238 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:56.226983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:56.228191 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-87f146d8-8408-47c9-b4e2-53be573288f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.835761 Aug 01 22:43:56.229072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:56.229235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 48/94] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:55 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:56.239536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:56.256236 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:56.257393 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-ee2cf6ac-6e63-4ab5-aaa6-80a3549bfb55 req-d9769d70-d599-4529-833b-5358a010449a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d", "tag": "0910ddf7-1491-401d-8e5a-8a12e83a6b3f"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:56.257916 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:56.258816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:56.260367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:56.294281 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-ee2cf6ac-6e63-4ab5-aaa6-80a3549bfb55 req-d9769d70-d599-4529-833b-5358a010449a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:56.295260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-ee2cf6ac-6e63-4ab5-aaa6-80a3549bfb55 req-d9769d70-d599-4529-833b-5358a010449a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:56.329107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-ee2cf6ac-6e63-4ab5-aaa6-80a3549bfb55 req-d9769d70-d599-4529-833b-5358a010449a service nova] Creating event network-changed:0910ddf7-1491-401d-8e5a-8a12e83a6b3f for instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d on hv-cinder-85164 Aug 01 22:43:56.339878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-ee2cf6ac-6e63-4ab5-aaa6-80a3549bfb55 req-d9769d70-d599-4529-833b-5358a010449a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108379 Aug 01 22:43:56.341608 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 49/95] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:56.423209 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:56.423929 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:56.438122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:56.438993 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:56.440623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:56.441296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:56.463533 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:56.479892 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a2fcf64-53fb-40a5-9427-0f3939805d0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.257878 Aug 01 22:43:56.482616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 47/96] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:56 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:56.626835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-24c5211a-42db-42eb-9b2f-6b9fa145015f req-7ea09c8c-66e8-4b83-86d5-b810c205fd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a237f2-d506-4bb5-97f5-29ee71910664", "name": "network-vif-plugged", "status": "completed", "tag": "482790be-cff8-4536-9a9e-1eb3977a415b"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:43:56.637359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-24c5211a-42db-42eb-9b2f-6b9fa145015f req-7ea09c8c-66e8-4b83-86d5-b810c205fd18 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:56.637829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-24c5211a-42db-42eb-9b2f-6b9fa145015f req-7ea09c8c-66e8-4b83-86d5-b810c205fd18 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:56.650185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-24c5211a-42db-42eb-9b2f-6b9fa145015f req-7ea09c8c-66e8-4b83-86d5-b810c205fd18 service nova] Creating event network-vif-plugged:482790be-cff8-4536-9a9e-1eb3977a415b for instance 80a237f2-d506-4bb5-97f5-29ee71910664 on hv-cinder-85164 Aug 01 22:43:56.652525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:56.655644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-24c5211a-42db-42eb-9b2f-6b9fa145015f req-7ea09c8c-66e8-4b83-86d5-b810c205fd18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098318 Aug 01 22:43:56.656309 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 48/97] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:43:56.660934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e3d087f8-fb98-477d-b2e4-a556e752ba0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.242517 Aug 01 22:43:56.661517 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 50/98] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:56 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:57.222404 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:57.223096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:57.229810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.230223 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.231137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.231543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.250227 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:57.250836 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:57.257986 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.258739 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.259514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.259946 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.374541 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:57.376869 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:43:57.384855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-faff39a0-75ac-49c8-887c-98507c64d133 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.167237 Aug 01 22:43:57.385812 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 49/99] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:57 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:57.450852 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:57.459358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:57.460885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:57.462011 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2e4d44e8-1919-409b-b4ce-7fb61833888b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.215672 Aug 01 22:43:57.462588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 51/100] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:57 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:43:57.502210 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:57.502721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:57.509287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.509879 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.510652 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.511074 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.657045 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:57.671256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5207d915-9a6a-4fb9-bb3c-20b76a5d29e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.172921 Aug 01 22:43:57.672712 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 50/101] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:57 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:57.698604 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:57.699225 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:57.709919 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.710385 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.711168 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:57.711892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:57.850837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:57.858678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c25aa54a-f956-4a29-b602-988946f85674 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.165933 Aug 01 22:43:57.859231 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 52/102] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:57 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:58.406021 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:58.406585 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:58.412915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:58.413367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:58.414173 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:58.414692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:58.484596 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:58.485864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:58.492372 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:58.492836 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:58.493590 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:58.494057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:58.560168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:58.570760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a7ff315-e007-484f-90e6-7f60315912e4 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.168468 Aug 01 22:43:58.590442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 51/103] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:58 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:43:58.699665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:58.701312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:58.729072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:58.730052 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:58.737727 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:58.741201 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:59.230648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:59.234659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:59.249723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a6d2da7-706b-41a3-a66a-d67f8daa9248 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.553823 Aug 01 22:43:59.261805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 52/104] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:58 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:43:59.268003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:59.269240 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:59.284617 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:59.285583 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:59.286607 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:59.286990 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:59.287651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:59.297991 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:43:59.302706 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-05ba2192-3f80-43b8-a99a-550d0747f29f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.821962 Aug 01 22:43:59.309502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 53/105] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:43:58 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:43:59.603581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:43:59.606203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:43:59.624465 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:59.626584 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:43:59.628004 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:43:59.629741 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:00.121088 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:00.161523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fe7f5c7a-d7b3-47ab-9c34-1e05d406cee7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.898075 Aug 01 22:44:00.169699 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 53/106] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:59 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:00.276751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:00.277799 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:00.288597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:00.290218 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:00.296898 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:00.298377 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:00.815111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:00.824902 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a86e936-3272-401d-a031-32adc3afdb9a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.555238 Aug 01 22:44:00.830594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 54/107] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:00 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:00.843151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:00.844623 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:00.859760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:00.860581 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:00.861605 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:00.864518 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:00.904046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:00.936079 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3a83cc02-7788-4bed-9cf9-d39972ad5156 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 1.337099 Aug 01 22:44:00.949583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 54/108] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:43:59 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:01.208219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:01.208840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:01.232319 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:01.232773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:01.233831 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:01.237789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:01.348949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:01.377846 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:01.383981 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:01.386852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-38285215-1579-4f0d-928c-68e69c32351f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.554456 Aug 01 22:44:01.388668 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 55/109] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:00 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:01.687352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:01.698959 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-14a7b359-e47b-4cd4-948e-acc88249db36 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.503841 Aug 01 22:44:01.699566 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 55/110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:01 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:01.874184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:01.875292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:01.890654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:01.891852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:01.894966 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:01.896334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:01.968010 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:01.968010 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:01.975037 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:01.975678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:01.976626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:01.977324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:02.229424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:02.257965 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d4c642ae-33f8-4b79-a572-6b318b86df20 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.391175 Aug 01 22:44:02.259430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 56/111] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:01 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:02.431703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:02.434748 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:02.450928 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:02.452083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:02.454369 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:02.455493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:02.462227 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:02.507527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-dacb3f07-ff6f-431b-82a7-0163bfa714be tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.546973 Aug 01 22:44:02.518656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 56/112] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:01 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:02.729959 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:02.730877 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:02.734421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:02.743114 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:02.743774 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:02.744731 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:02.745363 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:02.760270 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:02.763540 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:02.775082 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b89a4ec5-c4aa-4961-b8f5-d16f85fa4cd8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.343420 Aug 01 22:44:02.789657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 57/113] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:02 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:03.059311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-a8aaa38e-563c-4154-b175-c561dd63b955 req-a20ec738-a762-4190-af7b-b5d41f934e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b370cbad-46b8-4418-9b13-b7158495237c", "name": "network-vif-plugged", "status": "completed", "tag": "f8949b0e-8028-4226-9fec-5a9262634d95"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:03.084522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a8aaa38e-563c-4154-b175-c561dd63b955 req-a20ec738-a762-4190-af7b-b5d41f934e46 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:03.085439 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a8aaa38e-563c-4154-b175-c561dd63b955 req-a20ec738-a762-4190-af7b-b5d41f934e46 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:03.160547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-a8aaa38e-563c-4154-b175-c561dd63b955 req-a20ec738-a762-4190-af7b-b5d41f934e46 service nova] Creating event network-vif-plugged:f8949b0e-8028-4226-9fec-5a9262634d95 for instance b370cbad-46b8-4418-9b13-b7158495237c on hv-cinder-85164 Aug 01 22:44:03.183320 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-a8aaa38e-563c-4154-b175-c561dd63b955 req-a20ec738-a762-4190-af7b-b5d41f934e46 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126854 Aug 01 22:44:03.186292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 58/114] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:44:03.220937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:03.249619 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d35651ff-1df0-4b1e-b71f-47acb7a05ccb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.524114 Aug 01 22:44:03.266566 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 57/115] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:02 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:03.297910 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:03.298630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:03.317615 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:03.324104 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:03.324968 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:03.325428 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:03.547725 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:03.548356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:03.557470 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:03.557976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:03.559928 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:03.565637 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:03.741301 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:03.760547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a9526eb5-65a8-44cd-aef4-c9abe6c82313 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.466695 Aug 01 22:44:03.785665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 59/116] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:03 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:03.813323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:03.816454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:03.854953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:03.859326 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:03.864543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:03.865130 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:03.913134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:03.924553 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d54f686d-9a2e-464d-8a54-ad35057c8b4d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1314 microversion: 2.1 time: 0.384548 Aug 01 22:44:03.950396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 58/117] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:03 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:04.289637 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:04.291404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:04.303693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:04.310762 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:04.312806 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:04.313619 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:04.354955 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:04.366935 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:04.368899 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:04.371081 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3c16bc8f-531b-4a81-8e57-24532778ae9a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.567883 Aug 01 22:44:04.387337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 60/118] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:03 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:44:04.618297 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:04.641358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1cf13cf7-7973-4b82-863b-e7a94d7d7b91 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.355689 Aug 01 22:44:04.642025 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 59/119] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:04 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:04.793295 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:04.794361 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:04.810054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:04.810054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:04.810054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:04.810054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:04.954655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:04.955467 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:04.963928 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:04.965071 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:04.966307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:04.967070 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:05.107774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:05.117191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a559395-5b86-4708-ab49-8b764e7a9420 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.329247 Aug 01 22:44:05.130694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 61/120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:04 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:05.196870 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:05.215884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e19d934e-5310-421f-967f-28edfa9a24c1 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1501 microversion: 2.1 time: 0.264603 Aug 01 22:44:05.218206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 60/121] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:04 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1501 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:05.239164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-a2cea6e5-3960-44a5-8ed7-f9ab28c30a80 req-b3c701d1-8cf5-4e25-ab1e-d63ab081b561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c6c53e-256e-456b-abfc-cc69f4edfa2d", "name": "network-vif-plugged", "status": "completed", "tag": "5812ef14-fc5f-480a-9e1a-2c12b936b237"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:05.270082 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a2cea6e5-3960-44a5-8ed7-f9ab28c30a80 req-b3c701d1-8cf5-4e25-ab1e-d63ab081b561 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:05.270782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a2cea6e5-3960-44a5-8ed7-f9ab28c30a80 req-b3c701d1-8cf5-4e25-ab1e-d63ab081b561 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:05.297132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-a2cea6e5-3960-44a5-8ed7-f9ab28c30a80 req-b3c701d1-8cf5-4e25-ab1e-d63ab081b561 service nova] Creating event network-vif-plugged:5812ef14-fc5f-480a-9e1a-2c12b936b237 for instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d on hv-cinder-85164 Aug 01 22:44:05.303317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-a2cea6e5-3960-44a5-8ed7-f9ab28c30a80 req-b3c701d1-8cf5-4e25-ab1e-d63ab081b561 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068392 Aug 01 22:44:05.303929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 62/122] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:44:05.397490 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:05.398972 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:05.406958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:05.407670 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:05.408732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:05.409330 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:05.667392 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:05.668640 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:05.696870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:05.702729 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:05.704586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:05.707204 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:05.955468 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:05.966370 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:05.967937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:05.969109 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c4530e67-1f82-4c6d-9bf4-3e8cc22f2f18 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.577433 Aug 01 22:44:05.983870 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 61/123] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:05 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:05.984132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:05.991426 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7f0c2367-cf7d-47ca-aac1-a98a2488d576 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.332408 Aug 01 22:44:05.991943 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 63/124] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:05 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:06.144316 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:06.145571 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:06.154283 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:06.155529 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:06.157001 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:06.157726 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:06.388610 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:06.402949 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b41cf4ce-aacd-4a14-8826-effc156d7879 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.262905 Aug 01 22:44:06.403969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 62/125] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:06 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:07.002496 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:07.005297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:07.021109 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:07.021677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:07.022892 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:07.025709 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:07.047102 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:07.049688 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:07.067516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:07.069011 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:07.073478 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:07.074935 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:07.300969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:07.313038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:07.314909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:07.321697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-02287121-af62-4031-a388-d4988db13963 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.331046 Aug 01 22:44:07.337585 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 64/126] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:06 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:07.343860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-f37ea926-863b-4a7b-8543-f0134aa15df1 req-8233c484-5e87-4722-b346-5ef96265693b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909f43f2-82b3-496f-8561-f7e7e385a275", "name": "network-vif-plugged", "status": "completed", "tag": "0314aed5-18ce-4da4-b33f-5fc8da44e112"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:07.360726 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f37ea926-863b-4a7b-8543-f0134aa15df1 req-8233c484-5e87-4722-b346-5ef96265693b service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:07.361277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f37ea926-863b-4a7b-8543-f0134aa15df1 req-8233c484-5e87-4722-b346-5ef96265693b service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:07.374712 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-f37ea926-863b-4a7b-8543-f0134aa15df1 req-8233c484-5e87-4722-b346-5ef96265693b service nova] Creating event network-vif-plugged:0314aed5-18ce-4da4-b33f-5fc8da44e112 for instance 909f43f2-82b3-496f-8561-f7e7e385a275 on hv-cinder-85164 Aug 01 22:44:07.380581 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-f37ea926-863b-4a7b-8543-f0134aa15df1 req-8233c484-5e87-4722-b346-5ef96265693b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040921 Aug 01 22:44:07.381920 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 65/127] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:44:07.406544 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:07.414920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-17d5e46b-2148-454e-bd34-d0cccd884815 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.403251 Aug 01 22:44:07.416431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 63/128] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:07 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:07.428446 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:07.429158 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:07.438440 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:07.439654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:07.440448 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:07.440881 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:07.590370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:07.599416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e09e0145-1182-4419-8351-92e93198c447 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.178540 Aug 01 22:44:07.600081 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 66/129] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:07 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:08.352796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:08.354449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:08.367176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.369193 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:08.370814 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.372310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:08.447285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:08.450416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:08.468533 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.475651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:08.477209 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.478259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:08.652303 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:08.662038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:08.664447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:08.668214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f343ab82-2a74-49ba-836c-2fe6430a98be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.323879 Aug 01 22:44:08.669457 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 64/130] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:08 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:44:08.675278 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:08.676115 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:08.697040 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.697658 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:08.699241 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.700465 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:08.708077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:08.756701 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:08.766614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fb3e33bf-a88b-41fd-8772-9f86b3298f1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.332182 Aug 01 22:44:08.768310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 67/131] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:08 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:08.933068 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:08.941065 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7335e370-adcb-4b7d-ad71-a0c7b4cb8e2f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50a5c0ba-b4c8-4f22-b0c5-fc92bddf968e"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:08.943561 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7335e370-adcb-4b7d-ad71-a0c7b4cb8e2f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:08.945022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9a92dcc4-f395-4cb0-b888-bb8ed5669c3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.274224 Aug 01 22:44:08.959515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 65/132] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:08 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:08.961932 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7335e370-adcb-4b7d-ad71-a0c7b4cb8e2f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.962951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7335e370-adcb-4b7d-ad71-a0c7b4cb8e2f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:08.964760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7335e370-adcb-4b7d-ad71-a0c7b4cb8e2f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:08.965506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7335e370-adcb-4b7d-ad71-a0c7b4cb8e2f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:09.054060 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:09.697618 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:09.698308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:09.706749 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:09.707202 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:09.707973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:09.712215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:10.148567 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:10.159846 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:10.162921 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:10.164966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1bc548d5-7c06-4996-9d61-6247a21f1b58 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.471445 Aug 01 22:44:10.166360 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 66/133] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:09 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:10.174290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:10.175929 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:10.188368 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:10.189373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:10.190773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:10.191640 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:10.424550 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:10.445415 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-edadcd3c-30e1-4f41-87a1-0700ff72eade tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.276913 Aug 01 22:44:10.449921 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 67/134] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:10 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:10.470116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:10.470380 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:10.480455 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:10.480794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:10.481578 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:10.488127 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:10.576684 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7335e370-adcb-4b7d-ad71-a0c7b4cb8e2f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "POST /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.643975 Aug 01 22:44:10.586261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 68/135] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:44:08 2022] POST /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664/os-volume_attachments => generated 194 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:44:10.957098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:10.969731 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e6471f74-1109-4c92-b4d6-4f54a94cca7e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.517775 Aug 01 22:44:10.970695 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 68/136] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:10 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:11.211220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:11.212682 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:11.225694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:11.226939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:11.228324 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:11.228995 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:11.404616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:11.413746 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:11.416569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:11.418796 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d69b1e29-bf2e-43bc-b141-c9363d19c413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.213464 Aug 01 22:44:11.419714 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 69/137] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:11 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:44:11.493461 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:11.495279 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:11.506561 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:11.507318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:11.508721 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:11.509485 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:11.767131 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:11.777281 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-dce99ace-39ec-4791-8748-cb83067f49c6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.291785 Aug 01 22:44:11.779004 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 69/138] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:11 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:12.009050 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:12.010350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:12.013870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=99 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:12.029427 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:12.030268 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:12.031463 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:12.032162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:12.322507 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:12.343457 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ff11301a-412b-4fc9-a1bd-bac2dd2765b9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1363 microversion: 2.1 time: 0.341848 Aug 01 22:44:12.344519 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 70/139] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:11 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:12.463164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:12.465466 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:12.474772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=84 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:12.484291 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:12.486126 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:12.488043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:12.489242 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:12.813233 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:12.814601 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:12.814776 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:12.831071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:12.831896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:12.832695 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:12.833124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:12.839291 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:12.843327 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:12.845653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a5458393-b2d8-4dc5-98a7-0615c8b9ac69 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.392342 Aug 01 22:44:12.860031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 70/140] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:12 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:13.209368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:13.218769 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f9d6b51f-fb6b-49dd-a2a6-b6d605f7c299 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1322 microversion: 2.1 time: 0.414426 Aug 01 22:44:13.219005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 71/141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:12 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:13.376836 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:13.377860 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:13.389779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:13.391137 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:13.392531 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:13.393321 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:13.613524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:13.627726 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-27ad9259-2a50-44f9-b62c-00781d8cdb3e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1548 microversion: 2.1 time: 0.262132 Aug 01 22:44:13.629149 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 71/142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:13 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1548 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:13.671303 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-067b3e9f-fb49-4912-86c1-dfb6582d9b5d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:13.672581 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-067b3e9f-fb49-4912-86c1-dfb6582d9b5d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:13.687471 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-067b3e9f-fb49-4912-86c1-dfb6582d9b5d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:13.688502 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-067b3e9f-fb49-4912-86c1-dfb6582d9b5d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:13.690620 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-067b3e9f-fb49-4912-86c1-dfb6582d9b5d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:13.693057 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-067b3e9f-fb49-4912-86c1-dfb6582d9b5d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:13.882902 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-067b3e9f-fb49-4912-86c1-dfb6582d9b5d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226644 Aug 01 22:44:13.883538 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 72/143] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:44:13 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:44:13.891617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:13.892240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:13.902412 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:13.906074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:13.907611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:13.908620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:14.260416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:14.266794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:14.279881 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:14.280868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:14.282493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:14.283450 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:14.451055 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:14.469686 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:14.474106 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:14.476527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c44fb053-37aa-4ec5-a1f2-bdce54e7c67a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.588608 Aug 01 22:44:14.478275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 72/144] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:13 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:44:14.730352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:14.757952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-df17dc1b-9dda-49b5-b6c0-565a174e97f3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1516 microversion: 2.1 time: 0.505275 Aug 01 22:44:14.761496 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 73/145] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:14 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1516 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:14.801602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:14.804985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:14.829989 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:14.832146 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:14.833630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:14.834551 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:14.922007 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-b5a758d4-3979-4598-b269-4d9f5e83e836 req-243f0778-286b-4bdc-b4d5-7da05e05cd8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d", "name": "network-vif-plugged", "status": "completed", "tag": "0910ddf7-1491-401d-8e5a-8a12e83a6b3f"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:14.953071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b5a758d4-3979-4598-b269-4d9f5e83e836 req-243f0778-286b-4bdc-b4d5-7da05e05cd8c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:14.954695 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b5a758d4-3979-4598-b269-4d9f5e83e836 req-243f0778-286b-4bdc-b4d5-7da05e05cd8c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:14.982556 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-b5a758d4-3979-4598-b269-4d9f5e83e836 req-243f0778-286b-4bdc-b4d5-7da05e05cd8c service nova] Creating event network-vif-plugged:0910ddf7-1491-401d-8e5a-8a12e83a6b3f for instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d on hv-cinder-85164 Aug 01 22:44:14.985253 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lazy-loading 'flavor' on Instance uuid d8c6c53e-256e-456b-abfc-cc69f4edfa2d {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:44:14.995404 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-b5a758d4-3979-4598-b269-4d9f5e83e836 req-243f0778-286b-4bdc-b4d5-7da05e05cd8c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080990 Aug 01 22:44:14.999224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 74/146] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:44:15.374439 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-61de6347-5429-4446-bfd1-ff3a13dca3bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d/action" status: 200 len: 32 microversion: 2.1 time: 0.580437 Aug 01 22:44:15.382407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 73/147] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:44:14 2022] POST /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d/action => generated 32 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 22:44:15.391373 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:15.392804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:15.400034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:15.400889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:15.401938 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:15.402707 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:15.514089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:15.515008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:15.529916 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:15.530588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:15.532435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:15.532927 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:15.905048 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:15.924255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:15.941880 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:15.955082 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a7098f98-9497-42b1-9624-1abf1ed77a67 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.449810 Aug 01 22:44:15.962217 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 74/148] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:15 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:16.221524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:16.229545 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-30bb58ba-d971-465c-abca-211eb1764eef tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.844750 Aug 01 22:44:16.248788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 75/149] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:15 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:16.999623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:17.004251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:17.035800 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:17.036739 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:17.038283 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:17.043507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:17.258083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:17.260787 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:17.273775 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:17.275387 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:17.277625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:17.279124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:17.566779 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:17.594719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-446b2716-2e47-42e5-8024-2eab70a2b260 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.344560 Aug 01 22:44:17.642070 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 76/150] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:17 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:17.660003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-48b71aae-b928-4fd7-b0bc-11a1c43b211e req-e15a03c7-3255-4391-84a2-9208f692fd7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909f43f2-82b3-496f-8561-f7e7e385a275", "tag": "0314aed5-18ce-4da4-b33f-5fc8da44e112"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:17.682632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-48b71aae-b928-4fd7-b0bc-11a1c43b211e req-e15a03c7-3255-4391-84a2-9208f692fd7a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:17.684268 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-48b71aae-b928-4fd7-b0bc-11a1c43b211e req-e15a03c7-3255-4391-84a2-9208f692fd7a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:17.710701 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-48b71aae-b928-4fd7-b0bc-11a1c43b211e req-e15a03c7-3255-4391-84a2-9208f692fd7a service nova] Creating event network-changed:0314aed5-18ce-4da4-b33f-5fc8da44e112 for instance 909f43f2-82b3-496f-8561-f7e7e385a275 on hv-cinder-85164 Aug 01 22:44:17.718884 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-48b71aae-b928-4fd7-b0bc-11a1c43b211e req-e15a03c7-3255-4391-84a2-9208f692fd7a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073813 Aug 01 22:44:17.720069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 77/151] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:44:17.775383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:17.802594 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:17.810222 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:17.811692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b931ba81-2a9d-4018-8f5e-c9e62779a7f6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.819506 Aug 01 22:44:17.815555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 75/152] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:16 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:18.636475 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:18.637301 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:18.651186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:18.655180 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:18.656390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:18.658229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:18.840931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:18.842999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:18.870197 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:18.876081 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:18.878579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:18.894331 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:19.234123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:19.261327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-97957b8b-3cf5-4611-b4e0-090535694051 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.628927 Aug 01 22:44:19.262410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 78/153] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:18 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:19.323113 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:19.360918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:19.362650 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:19.365302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ed20bc8e-e574-41a8-bd49-c05e2ef3df47 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1407 microversion: 2.20 time: 0.532944 Aug 01 22:44:19.366501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 76/154] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:18 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:20.303951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:20.305374 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:20.319426 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:20.321287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:20.322639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:20.323197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:20.423233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:20.424668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:20.431574 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:20.432497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:20.433505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:20.434229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:20.704910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:20.725053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:20.729213 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:20.738144 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-567c4146-4534-459e-a2b1-24cdb6fa262d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1599 microversion: 2.20 time: 0.328593 Aug 01 22:44:20.743295 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 77/155] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:44:20 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1599 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:44:20.785310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0ebb445f-5d5a-4700-b4ad-014c535ec597 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:20.786587 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0ebb445f-5d5a-4700-b4ad-014c535ec597 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:20.797782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:20.798813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ebb445f-5d5a-4700-b4ad-014c535ec597 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:20.800285 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ebb445f-5d5a-4700-b4ad-014c535ec597 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:20.802993 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ebb445f-5d5a-4700-b4ad-014c535ec597 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:20.804556 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ebb445f-5d5a-4700-b4ad-014c535ec597 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:20.834262 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f8aa87d5-30d6-42e2-9cf0-c358cfabd385 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.522621 Aug 01 22:44:20.834262 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 79/156] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:20 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:20.921371 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0ebb445f-5d5a-4700-b4ad-014c535ec597 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142762 Aug 01 22:44:20.923076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 78/157] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 1 22:44:20 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:44:21.866844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:21.868166 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:21.884230 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:21.886604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:21.887741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:21.891884 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:22.314869 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:22.340404 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b00dbe88-1d30-49ee-af6b-fad8a6cc3677 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.476591 Aug 01 22:44:22.343725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 80/158] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:21 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:23.383637 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:23.385115 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:23.394688 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:23.395232 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:23.396264 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:23.396931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:23.870808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-151c5524-e2c1-4bfb-9fe1-6025388f3311 req-8e41ef52-fcf8-47eb-9932-e97c019978d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d", "tag": "0910ddf7-1491-401d-8e5a-8a12e83a6b3f"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:23.875124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:23.883290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-298de395-7361-40bc-90ef-628704f14155 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.518518 Aug 01 22:44:23.883891 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 79/159] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:23 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:23.890599 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-151c5524-e2c1-4bfb-9fe1-6025388f3311 req-8e41ef52-fcf8-47eb-9932-e97c019978d4 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:23.892407 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-151c5524-e2c1-4bfb-9fe1-6025388f3311 req-8e41ef52-fcf8-47eb-9932-e97c019978d4 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:23.925450 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-151c5524-e2c1-4bfb-9fe1-6025388f3311 req-8e41ef52-fcf8-47eb-9932-e97c019978d4 service nova] Creating event network-changed:0910ddf7-1491-401d-8e5a-8a12e83a6b3f for instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d on hv-cinder-85164 Aug 01 22:44:23.935598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-151c5524-e2c1-4bfb-9fe1-6025388f3311 req-8e41ef52-fcf8-47eb-9932-e97c019978d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068442 Aug 01 22:44:23.936572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 81/160] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:44:24.825023 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:24.825843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:24.837385 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:24.838692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:24.840976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:24.842339 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:24.859037 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:24.916778 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Going to try to terminate instance {{(pid=124356) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:44:24.919994 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:24.921349 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:24.944605 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:24.944972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:24.950072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:24.950706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:25.095184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f5bac36f-255e-4034-9248-750b538f0abb tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 204 len: 0 microversion: 2.1 time: 0.274668 Aug 01 22:44:25.096203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 80/161] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:44:24 2022] DELETE /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:44:25.106702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:25.108453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:25.116498 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:25.117275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:25.118358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:25.119008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:25.434538 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:25.457753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bc6e07ee-1901-451d-a2ea-44bd4f90ca4f tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1553 microversion: 2.1 time: 0.354883 Aug 01 22:44:25.465702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 81/162] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:25 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1553 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:25.547732 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:25.575393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f66417a1-5a97-4740-a226-179cf9f99bd4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.659819 Aug 01 22:44:25.576803 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 82/163] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:24 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:26.495326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:26.496727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:26.507599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:26.508517 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:26.510830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:26.514237 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:26.617715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:26.618830 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:26.657876 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:26.669696 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:26.670698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:26.671140 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:26.931344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:26.945261 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-95705086-b82a-422b-98f7-7c8729437d8e tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1553 microversion: 2.1 time: 0.454369 Aug 01 22:44:26.962003 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 82/164] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:26 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1553 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:27.103748 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:27.123435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f58f676c-a88c-429b-9f56-3bc4a76433fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.517406 Aug 01 22:44:27.125260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 83/165] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:26 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:27.969354 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:27.970999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:27.984708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:27.985624 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:27.987288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:27.988276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:28.168386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:28.169489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:28.212362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:28.213130 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:28.215001 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:28.215763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:28.413969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:28.443821 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7f9c034d-3e31-4a9a-a443-958ccee33549 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1553 microversion: 2.1 time: 0.480130 Aug 01 22:44:28.476791 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 83/166] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:27 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1553 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:28.526167 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:28.543387 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-302aa5b1-9f22-429b-9edd-95740561b84d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.382407 Aug 01 22:44:28.544597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 84/167] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:28 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:29.490475 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:29.493214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:29.508732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:29.510010 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:29.512347 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:29.513415 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:29.581891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:29.581891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:29.581891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:29.581891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:29.582991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:29.583358 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:29.857692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:29.883918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-56083140-405e-4b04-a724-562066396ffa tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1553 microversion: 2.1 time: 0.402351 Aug 01 22:44:29.886523 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 84/168] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:29 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:29.949359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:29.960655 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-da2e97b6-4b63-47ba-ac98-da06a8a29198 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.396260 Aug 01 22:44:29.962098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 85/169] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:29 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:30.043483 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-2a90667f-a0db-4a21-a4f5-3fa002da5b4c req-c555ebc7-806a-47f0-a190-432ef624ddec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a237f2-d506-4bb5-97f5-29ee71910664", "name": "network-vif-deleted", "tag": "482790be-cff8-4536-9a9e-1eb3977a415b"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:30.059691 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-2a90667f-a0db-4a21-a4f5-3fa002da5b4c req-c555ebc7-806a-47f0-a190-432ef624ddec service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:30.060218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-2a90667f-a0db-4a21-a4f5-3fa002da5b4c req-c555ebc7-806a-47f0-a190-432ef624ddec service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:30.076527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-2a90667f-a0db-4a21-a4f5-3fa002da5b4c req-c555ebc7-806a-47f0-a190-432ef624ddec service nova] Creating event network-vif-deleted:482790be-cff8-4536-9a9e-1eb3977a415b for instance 80a237f2-d506-4bb5-97f5-29ee71910664 on hv-cinder-85164 Aug 01 22:44:30.083697 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-2a90667f-a0db-4a21-a4f5-3fa002da5b4c req-c555ebc7-806a-47f0-a190-432ef624ddec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045075 Aug 01 22:44:30.086739 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 85/170] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:44:30.917653 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:30.920760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:30.936761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:30.937745 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:30.940354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:30.942198 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:30.983638 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:31.001031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:31.003549 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:31.023236 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:31.024413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:31.025781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:31.026434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:31.038889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:31.039931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:31.040905 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lazy-loading 'fault' on Instance uuid 80a237f2-d506-4bb5-97f5-29ee71910664 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:44:31.121231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ff5f41f9b44c2c9f5f90f13c266fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e72072c5cc453fbc31425b050a07c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:31.140637 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-48d3422d-887c-4671-821b-405a9bfd2353 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 200 len: 1350 microversion: 2.1 time: 0.236478 Aug 01 22:44:31.142666 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 86/171] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:30 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 1350 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:31.306867 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:31.315834 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2e773f36-de71-4644-a567-818e9fb158a5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.322505 Aug 01 22:44:31.316517 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 86/172] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:30 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:32.180269 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:32.180981 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:32.187984 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:32.188419 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:32.189425 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:32.190039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:32.209251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] HTTP exception thrown: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Request method failure captured: Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 HTTP/1.1 Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcHj1BDRrbY7Hhzcq5UZ4XQw0Md6ttH4FB91kFFsxiS9Ep7OlFHbKmGJG2NeJk7Vue1K3MrzZiyOskP7WyT8AvSylfiHQNg9lsWOm-7m9B8bxsy4nmh_n7Slg3QWNc8cHPu-6E8389iXQXQ1A2LzhORcgSMVWa0QwRFjoGEwjEX03k Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:44:32.214164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41e72072c5cc453fbc31425b050a07c1", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: a2ff5f41f9b44c2c9f5f90f13c266fbd Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.217068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '80a237f2-d506-4bb5-97f5-29ee71910664'} Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:44:32.218500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.220850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.222929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Returning 404 to user: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:44:32.222929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d774a88a-c19e-449c-ab8b-6bd25ec2e39b tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 404 len: 111 microversion: 2.1 time: 0.039876 Aug 01 22:44:32.222929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 87/173] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:32 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:44:32.356639 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:32.359573 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:32.372187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:32.373468 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:32.375642 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:32.376347 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:32.547327 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:32.563239 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-181851fa-6ece-431b-9a35-c6f2f817ea5b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.216322 Aug 01 22:44:32.564493 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 87/174] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:32 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:32.663773 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:32.668014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:32.675046 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:32.675827 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:32.676606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:32.677200 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:32.697804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] HTTP exception thrown: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Request method failure captured: Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664/os-volume_attachments HTTP/1.1 Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcHj1BDRrbY7Hhzcq5UZ4XQw0Md6ttH4FB91kFFsxiS9Ep7OlFHbKmGJG2NeJk7Vue1K3MrzZiyOskP7WyT8AvSylfiHQNg9lsWOm-7m9B8bxsy4nmh_n7Slg3QWNc8cHPu-6E8389iXQXQ1A2LzhORcgSMVWa0QwRFjoGEwjEX03k Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:44:32.702590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41e72072c5cc453fbc31425b050a07c1", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: a2ff5f41f9b44c2c9f5f90f13c266fbd Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.704742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'server_id': '80a237f2-d506-4bb5-97f5-29ee71910664'} Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:44:32.706421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:32.708193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:32.712638 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Returning 404 to user: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:44:32.715287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0f931b5a-92cc-42e0-8fe3-42c026b2b072 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058093 Aug 01 22:44:32.716362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 88/175] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:44:32 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 22:44:33.601779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:33.602368 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:33.609895 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:33.610510 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:33.611422 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:33.611864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:33.766516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:33.776062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4aa3dc3d-2f5f-4f45-b2a9-bc1d8528dabc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.179027 Aug 01 22:44:33.776749 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 88/176] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:33 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:34.233336 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:34.233954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:34.241503 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:34.241976 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:34.243358 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:34.244235 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:34.259432 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] HTTP exception thrown: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Request method failure captured: Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 HTTP/1.1 Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcHj1BDRrbY7Hhzcq5UZ4XQw0Md6ttH4FB91kFFsxiS9Ep7OlFHbKmGJG2NeJk7Vue1K3MrzZiyOskP7WyT8AvSylfiHQNg9lsWOm-7m9B8bxsy4nmh_n7Slg3QWNc8cHPu-6E8389iXQXQ1A2LzhORcgSMVWa0QwRFjoGEwjEX03k Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:44:34.261184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41e72072c5cc453fbc31425b050a07c1", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: a2ff5f41f9b44c2c9f5f90f13c266fbd Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.262936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '80a237f2-d506-4bb5-97f5-29ee71910664'} Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:44:34.268733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.270630 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.272323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Returning 404 to user: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:44:34.272323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-39196dd8-54e2-4509-a925-e2e5f952e3f6 tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 404 len: 111 microversion: 2.1 time: 0.033403 Aug 01 22:44:34.272323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 89/177] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:44:34 2022] DELETE /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:44:34.276361 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:34.277141 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] [instance: 80a237f2-d506-4bb5-97f5-29ee71910664] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:34.283289 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:34.283821 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:34.284649 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:34.285139 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:34.302326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] HTTP exception thrown: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Request method failure captured: Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 HTTP/1.1 Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcHj1BDRrbY7Hhzcq5UZ4XQw0Md6ttH4FB91kFFsxiS9Ep7OlFHbKmGJG2NeJk7Vue1K3MrzZiyOskP7WyT8AvSylfiHQNg9lsWOm-7m9B8bxsy4nmh_n7Slg3QWNc8cHPu-6E8389iXQXQ1A2LzhORcgSMVWa0QwRFjoGEwjEX03k Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:44:34.307345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41e72072c5cc453fbc31425b050a07c1", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41e72072c5cc453fbc31425b050a07c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 41e72072c5cc453fbc31425b050a07c1 Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-DeleteServersTestJSON-1101588903 Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: a2ff5f41f9b44c2c9f5f90f13c266fbd Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-DeleteServersTestJSON-1101588903-project Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.308767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '80a237f2-d506-4bb5-97f5-29ee71910664'} Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:44:34.309456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. Aug 01 22:44:34.310534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:44:34.311514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] Returning 404 to user: Instance 80a237f2-d506-4bb5-97f5-29ee71910664 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:44:34.311514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-913e1b40-a7c2-4c99-a02c-0b18cfe0a46d tempest-DeleteServersTestJSON-1101588903 tempest-DeleteServersTestJSON-1101588903-project] 10.222.0.47 "GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664" status: 404 len: 111 microversion: 2.1 time: 0.038883 Aug 01 22:44:34.311514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 89/178] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:34 2022] GET /compute/v2.1/servers/80a237f2-d506-4bb5-97f5-29ee71910664 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:44:34.803648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:34.804255 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:34.813529 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:34.814438 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:34.815971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:34.816648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:35.130039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:35.146654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-015c28b9-875e-415e-ac00-05dabb2472e2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.350867 Aug 01 22:44:35.148415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 90/179] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:34 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:36.183979 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:36.184618 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:36.204512 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:36.205381 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:36.209154 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:36.211318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:36.532026 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:36.551061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8efce0d4-528b-4469-8834-869791712bb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.370836 Aug 01 22:44:36.552199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 90/180] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:36 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:37.589625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:37.590607 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:37.617148 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:37.617851 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:37.618799 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:37.620377 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:37.931087 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:37.943739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-952610eb-b011-413b-bc0a-1aa79a8b9fb8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.361634 Aug 01 22:44:37.944338 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 91/181] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:37 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:38.974796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:38.975552 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:38.987212 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:38.988199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:38.992109 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:38.992916 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:39.494983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:39.509423 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-86d7e817-e01c-4428-bfe2-edbed2cebb11 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.537298 Aug 01 22:44:39.511215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 91/182] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:38 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:40.540936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:40.544005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:40.577047 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:40.577536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:40.588326 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:40.589169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:41.006168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:41.016634 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2c52a1fa-6ff5-406a-b905-2eb71b8acfce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.483619 Aug 01 22:44:41.018182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 92/183] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:40 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:42.070692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:42.071990 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:42.083010 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:42.083676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:42.084918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:42.085652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:42.332986 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:42.350773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-31311842-dfa8-4174-bc83-82bce1acdc52 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.287571 Aug 01 22:44:42.352820 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 92/184] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:42 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:43.379569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:43.380619 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:43.384595 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=48 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:43.394410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:43.395137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:43.396329 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:43.397049 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:43.694680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:43.711494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fcbcf012-8ecc-4796-97cb-fdecb5113e1d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.338326 Aug 01 22:44:43.712855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 93/185] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:43 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:44.746008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:44.747279 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:44.769744 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:44.772901 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:44.774436 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:44.776560 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:44.777203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:45.166139 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:45.177406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5a02016f-b314-4d98-bf12-054ba9376b6e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.437030 Aug 01 22:44:45.178472 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 93/186] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:44 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:46.214015 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:46.215177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:46.234310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:46.235030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:46.236005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:46.236617 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:46.581773 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:46.600556 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-93ee40cc-81a1-400d-89d3-dcc54a5a13f5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.399861 Aug 01 22:44:46.601540 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 94/187] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:46 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:47.366683 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1405706673", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "networks": [{"uuid": "e6192001-2827-497b-864f-a9643ea223c4"}]}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:47.455016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] validate_networks() for [('e6192001-2827-497b-864f-a9643ea223c4', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:44:47.638461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:47.640464 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:47.658232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:47.659169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:47.661100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:47.661958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:47.986704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:44:47.987483 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:44:47.988442 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:44:47.989595 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:44:47.990813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:44:48.005520 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:48.005985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:48.006949 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:48.007380 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:48.029089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Getting quotas for project 3e6c81f84dac4d9cafa3908a5896ae24. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:44:48.033590 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Getting quotas for user 26c501f3361e46239a6a492d0858afe2 and project 3e6c81f84dac4d9cafa3908a5896ae24. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:44:48.047162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:48.056596 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d8643b90-cc8c-4205-b7fc-0821795298df tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.424735 Aug 01 22:44:48.057972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 95/188] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:47 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:48.066175 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:44:48.070384 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:44:48.151334 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-713e113e-908d-4daf-b814-843bc1e3b272 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791569 Aug 01 22:44:48.152336 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 94/189] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:44:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:44:48.173547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-69cefac6-0026-479a-ad5a-a783a576fdf0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:48.175083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-69cefac6-0026-479a-ad5a-a783a576fdf0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:48.347442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69cefac6-0026-479a-ad5a-a783a576fdf0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:48.362031 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-69cefac6-0026-479a-ad5a-a783a576fdf0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1214 microversion: 2.1 time: 0.195733 Aug 01 22:44:48.363466 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 96/190] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:48 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:49.088185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:49.089310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:49.115924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:49.121476 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:49.127135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:49.128874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:49.396165 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:49.396969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:49.419292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:49.419739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:49.420512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:49.433109 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:49.539420 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:49.551419 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f868ffc4-3f45-4fce-b61d-725a1644ecc4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.469243 Aug 01 22:44:49.554904 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 95/191] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:49 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:49.932913 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:49.946700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-60877f12-4ae2-49f7-b1fa-51617a02b3dd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1210 microversion: 2.1 time: 0.562606 Aug 01 22:44:49.947883 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 97/192] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:49 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1210 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:50.596217 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:50.597260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:50.632418 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:50.632961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:50.634336 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:50.634997 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:50.983143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:50.984365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:51.024693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:51.035650 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:51.035895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:51.042476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:51.043001 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:51.053773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-23ec0def-9d35-4e81-8984-b436fcfa69bb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.464143 Aug 01 22:44:51.067415 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 96/193] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:50 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:51.184169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:51.205499 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-892ff781-0e18-4b6c-a000-f05288f322b8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1272 microversion: 2.1 time: 0.226092 Aug 01 22:44:51.206954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 98/194] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:50 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:52.085496 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:52.087983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:52.104135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:52.108722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:52.115188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:52.117648 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:52.137075 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:52.242097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:52.242097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:52.260475 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:52.261497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:52.265093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:52.267715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:52.540726 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:52.569315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-066eba2a-7198-402f-90e7-7f3c15d7d623 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.489908 Aug 01 22:44:52.571535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 97/195] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:52 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:52.781319 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:52.791999 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eb0d8f3c-0eea-43d3-86b6-930f0fa6fd94 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.562321 Aug 01 22:44:52.793203 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 99/196] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:52 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:53.122064 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-fa0fdcc8-7ea0-468d-9820-d97297dd9e4a req-dac515f4-29e1-47a7-b9ce-43bc09160915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d27ccd4-64ff-4110-a474-cf50915777bd", "tag": "d57398cd-44c7-414d-a225-51274da066f2"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:53.147435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-fa0fdcc8-7ea0-468d-9820-d97297dd9e4a req-dac515f4-29e1-47a7-b9ce-43bc09160915 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:53.149081 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-fa0fdcc8-7ea0-468d-9820-d97297dd9e4a req-dac515f4-29e1-47a7-b9ce-43bc09160915 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:53.176478 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-fa0fdcc8-7ea0-468d-9820-d97297dd9e4a req-dac515f4-29e1-47a7-b9ce-43bc09160915 service nova] Creating event network-changed:d57398cd-44c7-414d-a225-51274da066f2 for instance 8d27ccd4-64ff-4110-a474-cf50915777bd on hv-cinder-85164 Aug 01 22:44:53.187625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-fa0fdcc8-7ea0-468d-9820-d97297dd9e4a req-dac515f4-29e1-47a7-b9ce-43bc09160915 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074222 Aug 01 22:44:53.189627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 98/197] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:44:53.594492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:53.595249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:53.605651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:53.607272 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:53.609441 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:53.610346 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:53.831606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:53.834374 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:53.858304 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:53.859816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:53.863931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:53.865262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:54.078939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:54.116013 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-272e9135-3208-4c02-b4f4-48d31194ea7b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.526991 Aug 01 22:44:54.117132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 100/198] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:53 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:54.268167 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:54.283770 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-01092f52-a035-459b-91c0-55b611c63cda tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.460249 Aug 01 22:44:54.285601 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 99/199] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:53 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:55.157356 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:55.158262 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:55.172789 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:55.173236 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:55.175562 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:55.179216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:55.319484 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:55.321127 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:55.332769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:55.334110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:55.335635 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:55.337345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:55.350829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:55.362997 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-20557d31-e38f-47f3-b670-7e9057b51146 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.209305 Aug 01 22:44:55.366090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 101/200] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:55 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:55.543253 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:55.553208 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d5d177cf-4883-4bab-bf4f-d9f8abc725d1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.238890 Aug 01 22:44:55.554343 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 100/201] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:55 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:56.385796 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:56.386467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:56.396002 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:56.396415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:56.397305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:56.397816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:56.587025 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:56.588026 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:56.597271 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:56.598344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:56.599663 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:56.600632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:56.606616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:56.617345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1eb1b42e-7716-4d2e-aaf4-580a595a1f6a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.235419 Aug 01 22:44:56.618227 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 102/202] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:56 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:56.793063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:56.802910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2af34c1e-b1ce-4521-a456-812b5dcccf98 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.221463 Aug 01 22:44:56.818171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 101/203] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:56 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:57.642525 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:57.643562 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:57.653863 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:57.654229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:57.655010 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:57.655451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:57.825340 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:57.826812 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:57.834034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:57.834471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:57.835433 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:57.836015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:57.862491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:57.878234 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d12c3f36-c5e7-4905-9841-afb2e149633a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.242357 Aug 01 22:44:57.879282 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 103/204] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:57 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:58.015171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:58.024732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:58.029381 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-331aa15b-1b5a-45f1-8c2a-97bb4c3d4f20 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.207702 Aug 01 22:44:58.030184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 102/205] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:57 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:58.200156 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1026851112", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:44:58.255471 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] validate_networks() for None {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:44:58.356221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:58.620547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:44:58.621510 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:44:58.622244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:44:58.622914 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:44:58.623672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:44:58.639013 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:58.639578 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:58.640435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:58.640818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:58.663550 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Getting quotas for project 9e89f6a32366452592eb5a76f6af57fe. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:44:58.668886 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Getting quotas for user c3c864261ae94460ad72e2c3b709d8e3 and project 9e89f6a32366452592eb5a76f6af57fe. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:44:58.683275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:44:58.685662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:44:58.736441 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-86bd9191-69e3-4784-8398-2e74cc4f224c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540109 Aug 01 22:44:58.746074 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 104/206] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:44:58.751931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3c10a6f1-4e28-4b81-ac29-bec6913145bd tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:58.752685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3c10a6f1-4e28-4b81-ac29-bec6913145bd tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:58.755124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:58.849099 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3c10a6f1-4e28-4b81-ac29-bec6913145bd tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:58.858274 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3c10a6f1-4e28-4b81-ac29-bec6913145bd tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1215 microversion: 2.1 time: 0.110225 Aug 01 22:44:58.859964 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 103/207] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:58 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:58.913982 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:58.914928 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:58.925062 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:58.925842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:58.926824 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:58.927598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:59.051325 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:59.052361 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:59.060258 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:59.060967 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:59.062130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:59.062975 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:59.088798 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:59.097112 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-be04cea7-280a-4475-a26c-13bc1a39730b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.187624 Aug 01 22:44:59.098255 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 105/208] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:58 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:44:59.226933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:59.236266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-639301e7-6ccc-4f88-bb4b-b6a3043c3aec tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.189249 Aug 01 22:44:59.237086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 104/209] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:59 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:44:59.880078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:44:59.880752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:44:59.887987 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:59.888445 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:59.889221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:44:59.889692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:44:59.895070 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:44:59.962458 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:44:59.970655 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7c21f066-449b-4ced-a227-f1df9b67111d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1219 microversion: 2.1 time: 0.094522 Aug 01 22:44:59.971241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 106/210] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:44:59 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:00.119514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:00.120124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:00.126360 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:00.126813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:00.127572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:00.127999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:00.257884 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:00.258662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:00.265502 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:00.266115 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:00.267224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:00.267693 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:00.284534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:00.293613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d9066e71-a63f-4039-9540-ec1e674724a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.177818 Aug 01 22:45:00.294229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 105/211] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:00 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:00.452765 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:00.461045 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3c6b72b5-3317-459c-8bb7-34473ed0f619 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.207268 Aug 01 22:45:00.461665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 107/212] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:00 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:00.997833 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:00.998640 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:01.047847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:01.047847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:01.048080 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:01.048808 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:01.146699 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:01.155301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4dfc733b-9867-437c-9380-1a7ef53555c2 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1219 microversion: 2.1 time: 0.165756 Aug 01 22:45:01.155884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 106/213] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:00 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:01.318322 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:01.320681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:01.330785 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:01.331808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:01.332953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:01.333765 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:01.492792 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:01.493924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:01.501367 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:01.502087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:01.502875 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:01.503477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:01.518223 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:01.536967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ec59d92a-6af1-4478-8f72-67b4573f8d46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.215933 Aug 01 22:45:01.538522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 108/214] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:01 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:01.650938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:01.659055 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7c28818d-1f67-4399-8635-e94c62ea05b1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.179130 Aug 01 22:45:01.659639 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 107/215] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:01 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:02.181286 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:02.182033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:02.188743 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:02.189206 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:02.190074 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:02.190497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:02.255963 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:02.264868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bc6f037d-b7f8-42f5-8d42-aa72e09c6c74 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1267 microversion: 2.1 time: 0.087433 Aug 01 22:45:02.265924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 109/216] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:02 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:02.559414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:02.560044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:02.566906 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:02.567342 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:02.568164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:02.568583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:02.680091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:02.681357 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:02.688711 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:02.689458 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:02.690472 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:02.691080 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:02.729610 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:02.736351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-92ed85f6-7b2a-4e27-b8f3-bbc0437c1db2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.180841 Aug 01 22:45:02.738458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 108/217] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:02 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:02.844766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:02.853156 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2a09f6e7-2b84-481e-8e65-b0b568ee2468 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.177241 Aug 01 22:45:02.854086 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 110/218] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:02 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:03.286803 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:03.287424 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:03.293851 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:03.294304 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:03.295078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:03.295513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:03.366734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:03.374646 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3cf2e061-16de-4d10-8f35-0e4c85bff4e6 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1267 microversion: 2.1 time: 0.091798 Aug 01 22:45:03.375269 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 109/219] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:03 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:03.760778 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:03.761478 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:03.768559 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:03.768945 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:03.769738 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:03.770165 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:03.874130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:03.874735 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:03.881372 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:03.881865 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:03.882640 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:03.883062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:03.903016 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:03.911047 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a0ce58cc-af2c-4375-826d-723efba23fe5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.154267 Aug 01 22:45:03.911608 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 111/220] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:03 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:04.022878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:04.035042 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-83cd465c-d449-4f22-9e89-54bf1964ae5f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.164463 Aug 01 22:45:04.035939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 110/221] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:03 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:04.395256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:04.395763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:04.405239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:04.405994 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:04.406814 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:04.407363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:04.508209 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:04.522476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-40b297e2-03d9-47fa-8d78-860de7bd4186 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1267 microversion: 2.1 time: 0.130759 Aug 01 22:45:04.524464 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 112/222] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:04 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:04.941803 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:04.943097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:04.952616 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:04.953521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:04.954729 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:04.955470 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:05.061388 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:05.062163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:05.070889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:05.071812 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:05.072757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:05.073745 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:05.268618 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:05.289977 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-913d77a4-eb7a-4711-9feb-9a7ed908c519 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.358329 Aug 01 22:45:05.296266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 111/223] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:04 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:05.332332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:05.342041 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-79c8e5a1-a59a-44bb-9a75-118225ba5e4f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.288087 Aug 01 22:45:05.342989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 113/224] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:05 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:05.553726 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:05.554497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:05.571353 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:05.572004 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:05.572743 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:05.573185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:05.702189 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:05.716723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2142dd04-9437-4f3b-ade7-500103a4b2fb tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1273 microversion: 2.1 time: 0.168907 Aug 01 22:45:05.718031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 112/225] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:05 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:05.805125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-2cbc7c7d-c5b2-4d41-9720-b301860ec042 req-396499f5-7e12-4bb3-bf38-34138720445f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27ccd4-64ff-4110-a474-cf50915777bd", "name": "network-vif-plugged", "status": "completed", "tag": "d57398cd-44c7-414d-a225-51274da066f2"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:05.823481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2cbc7c7d-c5b2-4d41-9720-b301860ec042 req-396499f5-7e12-4bb3-bf38-34138720445f service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:05.823928 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2cbc7c7d-c5b2-4d41-9720-b301860ec042 req-396499f5-7e12-4bb3-bf38-34138720445f service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:05.843272 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-2cbc7c7d-c5b2-4d41-9720-b301860ec042 req-396499f5-7e12-4bb3-bf38-34138720445f service nova] Creating event network-vif-plugged:d57398cd-44c7-414d-a225-51274da066f2 for instance 8d27ccd4-64ff-4110-a474-cf50915777bd on hv-cinder-85164 Aug 01 22:45:05.853545 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-2cbc7c7d-c5b2-4d41-9720-b301860ec042 req-396499f5-7e12-4bb3-bf38-34138720445f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051620 Aug 01 22:45:05.855377 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 114/226] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:45:06.335536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:06.341790 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:06.358416 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:06.360917 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:06.375215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:06.378259 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:06.381783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:06.405762 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:06.435264 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:06.445399 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:06.446313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:06.450530 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:06.757040 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:06.766662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-14e95fa4-f54d-4c09-a7df-98f55a2719a1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.400998 Aug 01 22:45:06.767256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 115/227] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:06 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:06.789644 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:06.805189 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:06.805915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-21c86bfd-a322-4bb3-89a2-dc069860e3e5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.475469 Aug 01 22:45:06.806651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:06.807383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 113/228] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:06 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:06.819290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:06.819759 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:06.820548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:06.820987 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:07.055548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:07.078252 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-962adcc9-b2b8-44ee-81b1-2b4f3c7eb928 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.302522 Aug 01 22:45:07.096090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 116/229] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:06 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:07.333874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-8eb1360a-39a2-4c05-91d6-289def99986c req-6f15d640-2464-478d-9eb9-c52916542f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49ba364-f003-463e-b78e-ced853689a02", "tag": "c88bf7fe-e346-4ba3-bb81-cf1e76a017c1"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:07.361402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-8eb1360a-39a2-4c05-91d6-289def99986c req-6f15d640-2464-478d-9eb9-c52916542f95 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:07.363070 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-8eb1360a-39a2-4c05-91d6-289def99986c req-6f15d640-2464-478d-9eb9-c52916542f95 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:07.398883 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-8eb1360a-39a2-4c05-91d6-289def99986c req-6f15d640-2464-478d-9eb9-c52916542f95 service nova] Creating event network-changed:c88bf7fe-e346-4ba3-bb81-cf1e76a017c1 for instance f49ba364-f003-463e-b78e-ced853689a02 on hv-cinder-85164 Aug 01 22:45:07.409248 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-8eb1360a-39a2-4c05-91d6-289def99986c req-6f15d640-2464-478d-9eb9-c52916542f95 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086431 Aug 01 22:45:07.411767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 114/230] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:45:07.788188 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:07.789095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:07.797454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:07.798399 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:07.798865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:07.799344 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:07.835963 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:07.836937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:07.848149 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:07.849044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:07.849954 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:07.850620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:08.117980 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:08.140252 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-450eac90-a8a2-4b76-af53-18a380a701fe tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.312060 Aug 01 22:45:08.141257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 115/231] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:07 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:08.157542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:08.168624 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-25685b8c-42e3-4e39-8905-0fae09396067 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.385051 Aug 01 22:45:08.170215 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 117/232] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:07 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:08.206447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:08.207216 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:08.216038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:08.216487 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:08.217444 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:08.218109 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:08.223634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:08.416301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:08.432411 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0d63a0a3-1f83-4217-bbf1-cac282bbe02a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.231616 Aug 01 22:45:08.433128 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 116/233] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:08 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:09.166957 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:09.167579 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:09.169659 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:09.170291 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:09.177641 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:09.178127 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:09.178904 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:09.179331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:09.190731 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:09.191594 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:09.193745 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:09.201890 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:09.202513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:09.203519 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:09.204269 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:09.335982 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:09.344371 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e65aded2-2c76-4cb2-863b-443deae8d902 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.181341 Aug 01 22:45:09.344950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 118/234] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:09 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:09.347386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:09.357586 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5ac163e9-bbd4-4595-b27d-095b4a02dd0c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.170712 Aug 01 22:45:09.358185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 117/235] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:09 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:09.455005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:09.455617 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:09.462091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:09.462576 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:09.463355 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:09.463791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:09.601053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:09.608737 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a9905d3c-b448-4f40-8571-d2eb5381d5ec tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.157586 Aug 01 22:45:09.613060 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 119/236] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:09 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:10.366002 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:10.366577 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:10.373919 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:10.374364 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:10.375141 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:10.375565 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:10.378165 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:10.378734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:10.385874 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:10.386310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:10.387075 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:10.387497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:10.512461 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:10.521270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f47fe50b-d44c-40cf-9032-e10520970efc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.159198 Aug 01 22:45:10.533651 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 118/237] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:10 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:10.539253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:10.547160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-45670ab0-9a77-4c34-ac45-170e26e4804d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.172823 Aug 01 22:45:10.547777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 120/238] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:10 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:10.633923 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:10.634659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:10.641402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:10.641868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:10.642612 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:10.643057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:10.776509 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:10.784593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-107b5b79-ba2c-4867-8106-e353b1c1e701 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.154640 Aug 01 22:45:10.785180 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 119/239] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:10 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:11.546988 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:11.547787 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:11.556428 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:11.557143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:11.558736 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:11.559631 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:11.574731 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:11.576460 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:11.585536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:11.586855 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:11.588245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:11.589021 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:11.777539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:11.793802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-30e683fe-9ae8-4a21-ad65-d327f3dbcf74 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.252935 Aug 01 22:45:11.795815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 121/240] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:11 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:11.810858 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:11.812187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:11.823332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:11.824057 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:11.825157 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:11.825771 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:11.851134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:11.866134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1a18483b-3bed-415b-b25d-cd10950f827e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1314 microversion: 2.1 time: 0.297738 Aug 01 22:45:11.867245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 120/241] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:11 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:12.121099 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:12.146098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2c5743bc-de9f-4ac6-8227-481add7e6afc tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.342331 Aug 01 22:45:12.154788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 122/242] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:11 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:12.821867 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:12.822953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:12.832871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:12.833674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:12.834840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:12.835852 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:12.912565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:12.916787 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:12.928163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:12.929609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:12.931422 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:12.932634 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:12.963871 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:13.087553 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:13.098892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d221359a-6dfc-4f4a-98a4-344c894e5124 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.283052 Aug 01 22:45:13.113598 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 121/243] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:12 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:13.193976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:13.193976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:13.200874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:13.201332 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:13.206738 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:13.207468 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:13.532935 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:13.546692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-afe4ffdc-7a03-4249-81d9-298374ad7d98 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.365788 Aug 01 22:45:13.547727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 122/244] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:13 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:13.644670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:13.658330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-141feec3-2cdd-4756-b511-d36584e425e0 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1498 microversion: 2.1 time: 0.753829 Aug 01 22:45:13.659249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 123/245] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:12 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1498 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:14.140917 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:14.142078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:14.154350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.155226 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.156542 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.157326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.300916 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:14.306939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:14.313046 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:14.327629 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.329624 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.331676 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.332346 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.376586 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:14.385591 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6fa76349-752a-456b-a422-84d2db02b318 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1522 microversion: 2.1 time: 0.253637 Aug 01 22:45:14.386125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:45:14.386995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 123/246] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:14 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:14.598427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:14.601774 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:14.620157 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1eb9757f-be13-49bf-958d-2e133eda4608 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 204 len: 0 microversion: 2.1 time: 0.322209 Aug 01 22:45:14.620896 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.621596 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.624127 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 124/247] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:45:14 2022] DELETE /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:45:14.629536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.629536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.653164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:14.654582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:14.679027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.679914 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.682147 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:14.684433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:14.852593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:14.861306 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e801510e-0f01-4fd5-9038-ffa42bc4fdf5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.284082 Aug 01 22:45:14.862225 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 124/248] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:14 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:14.914516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:14.925771 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9dd53742-e688-450c-b608-8ead1621860b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1504 microversion: 2.1 time: 0.289946 Aug 01 22:45:14.926685 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 125/249] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:14 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:15.418768 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:15.419725 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:15.428554 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:15.442308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:15.443656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:15.445023 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:15.446076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:15.652613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:15.674451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-765084dc-6a73-467b-a4e0-6039bc23a1a4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1502 microversion: 2.1 time: 0.262129 Aug 01 22:45:15.675441 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 125/250] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:15 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:15.703960 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:15.704889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:15.718243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:15.718683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:15.719480 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:15.719944 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:15.884763 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:15.885734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:15.897841 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:15.899071 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:15.900434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:15.901223 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:15.956600 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:15.974293 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-da43fd46-ab48-45fd-a0b0-70b0aad53ad5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1517 microversion: 2.1 time: 0.275331 Aug 01 22:45:15.975486 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 126/251] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:15 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1517 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:15.998568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:16.000688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:16.024237 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:16.025160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:16.026650 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:16.027384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:16.186540 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:16.202632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1351ef14-51c7-4a08-ba9d-f35a8e64250b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.322621 Aug 01 22:45:16.203569 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 126/252] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:15 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:16.311666 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:16.320515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-694cd946-05b8-4eaf-815a-b1fb4a9b95af tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1504 microversion: 2.1 time: 0.343219 Aug 01 22:45:16.321033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 127/253] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:15 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1504 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:17.237903 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:17.238854 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:17.247426 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.248173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:17.249343 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.249592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:17.366524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:17.367804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:17.379237 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.380213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:17.381325 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.382124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:17.461656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:17.480985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7b9c4b73-20fb-4c3d-9e6f-3e34883fcdff tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.250547 Aug 01 22:45:17.482054 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 127/254] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:17 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:17.570784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:17.582539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9463e393-a34d-4da4-a4e7-1e868e28a1ed tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1504 microversion: 2.1 time: 0.223030 Aug 01 22:45:17.583362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 128/255] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:17 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:17.658455 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:17.665045 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:17.680857 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.681484 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:17.682869 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.683463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:17.725274 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lazy-loading 'flavor' on Instance uuid b370cbad-46b8-4418-9b13-b7158495237c {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:45:17.835837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-cba3c167-8b14-44ac-a119-e9c2f3bb2b0b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c/action" status: 200 len: 32 microversion: 2.1 time: 0.184426 Aug 01 22:45:17.836854 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 128/256] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:45:17 2022] POST /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:45:17.852436 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:17.854127 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:17.865359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.866182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:17.867981 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:17.869300 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:18.084334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:18.103127 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e87e9bcb-ca26-441e-9abb-fa186e2a7a46 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.258365 Aug 01 22:45:18.105729 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 129/257] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:17 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:18.519500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:18.520840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:18.536092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:18.537351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:18.539038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:18.540091 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:18.619945 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:18.621030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:18.635943 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:18.636825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:18.638332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:18.639082 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:18.788530 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:18.851908 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-562a9973-7181-4f50-a1f9-4d96e114b2d5 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.342172 Aug 01 22:45:18.862747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 129/258] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:18 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:19.024228 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-e9b8669d-a5ab-40ac-afc7-d829f5783ba7 req-1df80318-9298-4dee-bb14-c4881b396932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27ccd4-64ff-4110-a474-cf50915777bd", "name": "network-vif-deleted", "tag": "d57398cd-44c7-414d-a225-51274da066f2"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:19.042742 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-e9b8669d-a5ab-40ac-afc7-d829f5783ba7 req-1df80318-9298-4dee-bb14-c4881b396932 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:19.044134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-e9b8669d-a5ab-40ac-afc7-d829f5783ba7 req-1df80318-9298-4dee-bb14-c4881b396932 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:19.060739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:19.065399 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-e9b8669d-a5ab-40ac-afc7-d829f5783ba7 req-1df80318-9298-4dee-bb14-c4881b396932 service nova] Creating event network-vif-deleted:d57398cd-44c7-414d-a225-51274da066f2 for instance 8d27ccd4-64ff-4110-a474-cf50915777bd on hv-cinder-85164 Aug 01 22:45:19.068877 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-35e56aa6-cbf6-4b5a-b2b1-2d31473886c9 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1504 microversion: 2.1 time: 0.456895 Aug 01 22:45:19.069721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 130/259] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:18 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:19.081790 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-e9b8669d-a5ab-40ac-afc7-d829f5783ba7 req-1df80318-9298-4dee-bb14-c4881b396932 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071428 Aug 01 22:45:19.081790 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 130/260] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:45:19.127907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:19.128707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:19.139897 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:19.140750 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:19.142082 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:19.142699 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:19.169514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:19.347085 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:19.363430 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e86a03d3-169c-4216-9bc9-d0d8d2c5fd0a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.239604 Aug 01 22:45:19.364130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 131/261] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:19 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:19.879821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:19.880993 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:19.889136 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:19.889875 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:19.890861 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:19.891468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:20.095600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:20.097681 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:20.126125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:20.126952 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:20.128037 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:20.128652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:20.239884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:20.241033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:20.242625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lazy-loading 'fault' on Instance uuid 8d27ccd4-64ff-4110-a474-cf50915777bd {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:45:20.350681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:20.352467 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:20.359909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3e081e22-c51b-4bea-aa8c-52ced8522cb9 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.483902 Aug 01 22:45:20.361197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 131/262] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:19 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:20.372176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ec440335-69a8-4c25-b02f-a2935ff0bfdd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 200 len: 1304 microversion: 2.1 time: 0.277376 Aug 01 22:45:20.372176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 132/263] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:20 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 1304 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:20.394382 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:20.395502 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:20.405338 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:20.406053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:20.407802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:20.408531 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:20.632500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:20.641383 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d4c3d67b-b9fa-43cb-ae8f-fb41702a4347 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.253529 Aug 01 22:45:20.642248 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 132/264] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:20 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:21.389868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:21.391783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 8d27ccd4-64ff-4110-a474-cf50915777bd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:21.393027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:21.395253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:21.401468 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:21.402270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:21.403428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:21.404128 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:21.411058 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:21.411537 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:21.412241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:21.412667 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:21.422154 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] HTTP exception thrown: Instance 8d27ccd4-64ff-4110-a474-cf50915777bd could not be found. Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Request method failure captured: Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd HTTP/1.1 Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fdchc33dGXXCnPj0zW4stQSgDjhz5dG29IPv8yQJ7tRI803lFej6iLD77M2aZGcMforKAJYpf0A_DruvpX4CqQCuSDlpdLnSxdWNjrV6PO3p6Km8a4US8EqfkR2d3pi0l7xLKpCd78RzgcIPsXzUqu44C5E6S9gCDK86QiNpWc8SPg Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 3e6c81f84dac4d9cafa3908a5896ae24 Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesActionsTest-1919304832 Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:45:21.423819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e6c81f84dac4d9cafa3908a5896ae24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3e6c81f84dac4d9cafa3908a5896ae24", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3e6c81f84dac4d9cafa3908a5896ae24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e6c81f84dac4d9cafa3908a5896ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesActionsTest-1919304832 Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 3e6c81f84dac4d9cafa3908a5896ae24 Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesActionsTest-1919304832 Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesActionsTest-1919304832-project Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 26c501f3361e46239a6a492d0858afe2 Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesActionsTest-1919304832-project Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 8d27ccd4-64ff-4110-a474-cf50915777bd could not be found. Aug 01 22:45:21.426693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '8d27ccd4-64ff-4110-a474-cf50915777bd'} Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d27ccd4-64ff-4110-a474-cf50915777bd could not be found. Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:45:21.428224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d27ccd4-64ff-4110-a474-cf50915777bd could not be found. Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d27ccd4-64ff-4110-a474-cf50915777bd could not be found. Aug 01 22:45:21.430992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:45:21.434001 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Returning 404 to user: Instance 8d27ccd4-64ff-4110-a474-cf50915777bd could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:45:21.434001 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e8a4c1a2-7670-44d0-9b38-af9264b6055f tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd" status: 404 len: 111 microversion: 2.1 time: 0.041425 Aug 01 22:45:21.434001 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 133/265] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:21 2022] GET /compute/v2.1/servers/8d27ccd4-64ff-4110-a474-cf50915777bd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:45:21.581864 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-240153530", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "networks": [{"uuid": "e6192001-2827-497b-864f-a9643ea223c4"}]}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:21.591330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:21.599595 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-03f3a3ae-2a9e-40c6-89ab-fb928971fe38 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.213563 Aug 01 22:45:21.600352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 133/266] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:21 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:21.671698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:21.672632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:21.683433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:21.684196 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:21.685515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:21.686297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:21.922681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:21.932851 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bc255b8f-75ed-49e7-9957-69d46d2b95b9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.268135 Aug 01 22:45:21.933430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 134/267] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:21 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:21.938286 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-e5b9f47e-a109-4e18-b083-235711ed93c5 req-356dc29a-e9a5-4e7b-9ae2-cf4bbe6b7a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49ba364-f003-463e-b78e-ced853689a02", "name": "network-vif-plugged", "status": "completed", "tag": "c88bf7fe-e346-4ba3-bb81-cf1e76a017c1"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:21.948277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-e5b9f47e-a109-4e18-b083-235711ed93c5 req-356dc29a-e9a5-4e7b-9ae2-cf4bbe6b7a66 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:21.949059 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-e5b9f47e-a109-4e18-b083-235711ed93c5 req-356dc29a-e9a5-4e7b-9ae2-cf4bbe6b7a66 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:21.964389 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-e5b9f47e-a109-4e18-b083-235711ed93c5 req-356dc29a-e9a5-4e7b-9ae2-cf4bbe6b7a66 service nova] Creating event network-vif-plugged:c88bf7fe-e346-4ba3-bb81-cf1e76a017c1 for instance f49ba364-f003-463e-b78e-ced853689a02 on hv-cinder-85164 Aug 01 22:45:21.972168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-e5b9f47e-a109-4e18-b083-235711ed93c5 req-356dc29a-e9a5-4e7b-9ae2-cf4bbe6b7a66 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036986 Aug 01 22:45:21.973649 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 135/268] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:45:22.636477 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:22.637672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:22.646072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:22.646426 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:22.647199 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:22.647632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:22.799986 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:22.811333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e46cb85f-b214-4168-b14b-b31b1dde89e3 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.182869 Aug 01 22:45:22.812361 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 136/269] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:22 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:22.956560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:22.957172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:22.963745 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:22.964193 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:22.964974 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:22.965810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:23.128116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:23.141533 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d42bd7af-9131-4f84-9de5-d82df3d88351 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.188567 Aug 01 22:45:23.142964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 137/270] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:22 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:23.843946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:23.844616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:23.851540 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:23.851975 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:23.852722 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:23.853194 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:24.021473 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:24.031636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e612bbf0-b855-452c-b423-7a21c26e4579 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.192024 Aug 01 22:45:24.032226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 138/271] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:23 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:24.170653 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:24.171571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:24.182806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:24.183521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:24.184911 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:24.185705 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:24.190715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:24.395017 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:24.406460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-007b8a4a-bb90-4656-8a37-b75b68c0ed3e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.242526 Aug 01 22:45:24.407207 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 139/272] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:24 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:25.056420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:25.057472 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:25.064772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:25.065311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:25.066183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:25.066651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:25.248901 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:25.261978 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e3a56463-5f28-4370-aea8-e31feaae6782 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.211788 Aug 01 22:45:25.264030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 140/273] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:25 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:25.432951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:25.434137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:25.443352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:25.443912 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:25.444838 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:25.445332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:25.614430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:25.627916 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ac093843-75ca-4dec-b3bd-ecc331dee3fc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.202267 Aug 01 22:45:25.629123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 141/274] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:25 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:26.291613 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:26.292490 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:26.300866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:26.301116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:26.301932 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:26.302371 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:26.505507 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:26.515755 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cfba43b8-42e0-48ca-93bc-0da232949ce4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.229303 Aug 01 22:45:26.516349 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 142/275] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:26 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:26.660554 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:26.661760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:26.669900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:26.670310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:26.671108 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:26.671551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:26.863853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:26.876782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-10a6544b-c226-4175-8351-95b990a6fd96 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.223467 Aug 01 22:45:26.877845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 143/276] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:26 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:27.545866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:27.546854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:27.557295 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:27.558035 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:27.559279 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:27.559971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:27.755679 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:27.767113 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-182470bb-3bc1-4fe2-8adf-2dce549be2c4 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.227152 Aug 01 22:45:27.768553 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 144/277] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:27 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:27.904731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:27.905339 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:27.911867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:27.912316 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:27.913127 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:27.913585 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:28.077110 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:28.091097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-668140c0-1dcb-4f24-ae7a-d4f5e0fd9611 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.190158 Aug 01 22:45:28.091767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 145/278] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:27 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:28.802881 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:28.803841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:28.818404 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:28.819095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:28.820256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:28.820948 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:29.004649 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:29.013354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9d761101-5e4b-4c8f-81a9-15dfd6cd4a5d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.216643 Aug 01 22:45:29.014016 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 146/279] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:28 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:29.113069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:29.113602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:29.123135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:29.123918 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:29.125149 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:29.125782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:29.305482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:29.317272 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b776d8f7-bab2-48ea-bb4d-9211ff5d38ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.208064 Aug 01 22:45:29.322019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 147/280] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:29 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:30.043058 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:30.043958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:30.051750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:30.052332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:30.053211 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:30.053839 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:30.222602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:30.234675 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7cc56637-ef85-41c3-a415-d5a338ef48ea tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1315 microversion: 2.1 time: 0.195229 Aug 01 22:45:30.235659 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 148/281] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:30 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:30.344440 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:30.345092 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:30.352537 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:30.352983 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:30.353838 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:30.354273 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:30.513386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:30.521680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e82a571a-af72-4293-a6ea-7ff9960098cd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.181895 Aug 01 22:45:30.522303 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 149/282] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:30 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:30.960475 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0a4c9600-3014-40dd-947b-4887cdea7936 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:30.961622 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0a4c9600-3014-40dd-947b-4887cdea7936 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:30.972412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a4c9600-3014-40dd-947b-4887cdea7936 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:30.972854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a4c9600-3014-40dd-947b-4887cdea7936 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:30.973803 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a4c9600-3014-40dd-947b-4887cdea7936 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:30.974306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a4c9600-3014-40dd-947b-4887cdea7936 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.006909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0a4c9600-3014-40dd-947b-4887cdea7936 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/ips" status: 200 len: 152 microversion: 2.20 time: 0.053631 Aug 01 22:45:31.007855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 150/283] 10.222.0.47 () {60 vars in 1289 bytes} [Mon Aug 1 22:45:30 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/ips => generated 152 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:45:31.269188 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:31.272340 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:31.284514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.286345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.288458 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.289687 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.412094 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=12 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:31.488393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:31.499085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a335dbe2-d6a6-4c3b-bf1c-49f6f91c1779 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1465 microversion: 2.1 time: 0.238007 Aug 01 22:45:31.499908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 151/284] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:31 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1465 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:31.557146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:31.558334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:31.569470 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.570283 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.571694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.572525 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.593805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=21 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:31.783820 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:31.798830 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a5b32deb-51fe-4998-9067-8955b798a21d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.247257 Aug 01 22:45:31.798830 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 152/285] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:31 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:31.806142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:31.807449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:31.825402 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.826384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.828134 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.828964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.870230 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:45:31.979656 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1dbf48ba-768f-4498-afc6-538dda0fc60b tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 204 len: 0 microversion: 2.1 time: 0.179364 Aug 01 22:45:31.980258 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 153/286] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:45:31 2022] DELETE /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:45:31.989076 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:31.989818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:31.997138 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.997716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:31.998515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:31.998949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:32.017828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:32.211210 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:32.224721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f49ba06d-cb1a-49a3-adcc-2ae3a8225f2c tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1471 microversion: 2.1 time: 0.239641 Aug 01 22:45:32.225774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 154/287] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:31 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:32.830512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:32.831489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:32.838964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:32.839463 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:32.840706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:32.841307 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:33.041535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:33.054229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-84494175-9d52-4f5c-abe5-8b7e36de88d3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.230012 Aug 01 22:45:33.055286 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 155/288] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:32 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:33.250158 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:33.250842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:33.262412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:33.263299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:33.264639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:33.265385 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:33.468142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:33.477734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3d0cff13-0bb3-4d23-a503-1fb35fcb337a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1471 microversion: 2.1 time: 0.233350 Aug 01 22:45:33.478659 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 156/289] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:33 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:34.041596 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] validate_networks() for [('e6192001-2827-497b-864f-a9643ea223c4', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:45:34.079045 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:34.080003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:34.091524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:34.092186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:34.093543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:34.094328 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:34.253570 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:34.267518 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fef32f2d-2c5b-47ae-85b5-6c016403b7b0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.193866 Aug 01 22:45:34.268305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 157/290] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:34 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:34.503739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:34.505024 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:34.512061 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:34.512508 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:34.513289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:34.513768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:34.623325 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:45:34.624093 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:45:34.624929 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:45:34.625667 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:45:34.626688 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:45:34.639817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:34.640391 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:34.641366 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:34.641954 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:34.665126 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Getting quotas for project 3e6c81f84dac4d9cafa3908a5896ae24. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:45:34.669987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Getting quotas for user 26c501f3361e46239a6a492d0858afe2 and project 3e6c81f84dac4d9cafa3908a5896ae24. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:45:34.685000 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:45:34.687205 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:45:34.687588 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:34.697956 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8ca6dfe9-40f4-44b4-af06-5305629fd76a tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1471 microversion: 2.1 time: 0.198012 Aug 01 22:45:34.698871 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 158/291] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:34 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:34.753772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bd874308-d080-40c0-bd52-8c181c6b5fcf tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.174722 Aug 01 22:45:34.765464 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 134/292] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 13178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 22:45:34.775576 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1b24921f-bfd8-4773-b535-5adbd63db56a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:34.776665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1b24921f-bfd8-4773-b535-5adbd63db56a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:34.854440 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1b24921f-bfd8-4773-b535-5adbd63db56a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:34.864253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1b24921f-bfd8-4773-b535-5adbd63db56a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1213 microversion: 2.1 time: 0.095671 Aug 01 22:45:34.864965 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 159/293] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:34 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:35.290727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:35.291357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:35.298186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:35.298630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:35.299421 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:35.299855 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:35.451072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:35.458940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0b514899-21cf-450e-9e3d-b9a250d45d3c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.172402 Aug 01 22:45:35.459525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 135/294] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:35 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:35.725531 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:35.726686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:35.737539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:35.738250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:35.739454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:35.740214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:35.884389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:35.885000 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:35.891391 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:35.891842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:35.892621 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:35.893050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:35.937833 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:35.946285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5f8b13b1-6355-43d9-9042-cd2fdb87ec0d tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1471 microversion: 2.1 time: 0.226219 Aug 01 22:45:35.946875 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 160/295] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:35 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:35.970999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:35.979591 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8266c194-5788-44f8-baf1-972cbf321959 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1217 microversion: 2.1 time: 0.098950 Aug 01 22:45:35.980094 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 136/296] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:35 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:36.487790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:36.488446 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:36.495900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:36.496228 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:36.496979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:36.497398 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:36.680646 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:36.694741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cabce85a-f2ab-4ecd-8ebf-6f9078edeb67 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.210933 Aug 01 22:45:36.695775 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 161/297] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:36 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:36.756847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:36.758761 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:36.768093 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:36.768878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:36.770275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:36.771026 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:36.830204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lazy-loading 'flavor' on Instance uuid 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:45:36.980100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:36.980100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:36.989481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:36.989856 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:36.991122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:36.991851 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:37.125730 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-79c25cb3-cbb3-47c6-8525-af7ec8c16324 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/action" status: 202 len: 0 microversion: 2.20 time: 0.376451 Aug 01 22:45:37.126340 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 137/298] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 1 22:45:36 2022] POST /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:45:37.132953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:37.138700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:37.153926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:37.153926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:37.156667 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:37.157362 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:37.199641 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:37.214611 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9687e009-34e7-4a39-8a8a-e4acc8b66ee0 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1471 microversion: 2.1 time: 0.241773 Aug 01 22:45:37.216058 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 162/299] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:36 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:37.221469 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:37.222856 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:37.235991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:37.236627 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:37.237424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:37.238163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:37.292463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:37.310463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-104b1460-2430-4bf3-a4e6-c44c5b772123 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1265 microversion: 2.1 time: 0.182323 Aug 01 22:45:37.311550 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 138/300] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:37 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:37.592621 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:37.606238 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:37.609604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:37.610925 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-725a4353-9c42-4404-85e3-a0d7efdb4f5f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.393674 Aug 01 22:45:37.612405 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 163/301] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:37 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:37.637666 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-9fafbecc-24b5-4407-b6c4-6f93a5ae367f req-7a9f4247-012b-49e2-a66e-c8670d9b157e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49ba364-f003-463e-b78e-ced853689a02", "name": "network-vif-deleted", "tag": "c88bf7fe-e346-4ba3-bb81-cf1e76a017c1"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:37.663994 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-9fafbecc-24b5-4407-b6c4-6f93a5ae367f req-7a9f4247-012b-49e2-a66e-c8670d9b157e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:37.666175 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-9fafbecc-24b5-4407-b6c4-6f93a5ae367f req-7a9f4247-012b-49e2-a66e-c8670d9b157e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:37.707257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-9fafbecc-24b5-4407-b6c4-6f93a5ae367f req-7a9f4247-012b-49e2-a66e-c8670d9b157e service nova] Creating event network-vif-deleted:c88bf7fe-e346-4ba3-bb81-cf1e76a017c1 for instance f49ba364-f003-463e-b78e-ced853689a02 on hv-cinder-85164 Aug 01 22:45:37.713483 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-9fafbecc-24b5-4407-b6c4-6f93a5ae367f req-7a9f4247-012b-49e2-a66e-c8670d9b157e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087612 Aug 01 22:45:37.714779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 139/302] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:45:37.729632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:37.730262 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:37.740365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:37.740835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:37.741803 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:37.742085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.064687 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-78b70643-826a-458a-af91-23e148ef3747 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:38.065485 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:38.066148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-78b70643-826a-458a-af91-23e148ef3747 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:38.078904 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f6e65fb4-9161-4f92-9899-2fae4b3d9da1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.353955 Aug 01 22:45:38.079724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 164/303] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:37 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:38.080182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-78b70643-826a-458a-af91-23e148ef3747 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.080919 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-78b70643-826a-458a-af91-23e148ef3747 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.082644 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-78b70643-826a-458a-af91-23e148ef3747 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.083500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-78b70643-826a-458a-af91-23e148ef3747 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.128610 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-78b70643-826a-458a-af91-23e148ef3747 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/ips" status: 200 len: 144 microversion: 2.1 time: 0.072758 Aug 01 22:45:38.132457 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 140/304] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:45:38 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/ips => generated 144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:45:38.243025 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:38.243704 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:38.250750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.251526 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.252353 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.252840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.303369 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.304029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.304791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lazy-loading 'fault' on Instance uuid f49ba364-f003-463e-b78e-ced853689a02 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:45:38.352811 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:38.354215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:38.364335 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.365597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.366642 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.367449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.376482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c864261ae94460ad72e2c3b709d8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89f6a32366452592eb5a76f6af57fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:38.385121 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e73c6773-38d2-40c0-90f3-83e13d73b8a7 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 200 len: 1305 microversion: 2.1 time: 0.146889 Aug 01 22:45:38.385772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 165/305] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:38 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:38.487794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:38.514325 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c57fc96c-c207-457d-8681-01435e34dd9e tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1271 microversion: 2.1 time: 0.167724 Aug 01 22:45:38.515081 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 141/306] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:38 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:38.659956 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:38.663849 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:38.675863 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:38.688923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.689847 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.691368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:38.692178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:38.939958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:38.954505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:38.957307 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:38.959568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-db000e3c-b19c-4be0-aaca-c1ad3abfea12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.322199 Aug 01 22:45:38.960573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 166/307] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:38 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:39.104911 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:39.105638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:39.112215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:39.112762 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:39.113634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:39.114143 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:39.343484 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:39.361315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b60f5a88-00f4-45c6-a28f-813fb1024a1a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.261117 Aug 01 22:45:39.374893 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 142/308] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:39 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:39.416452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:39.417549 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] [instance: f49ba364-f003-463e-b78e-ced853689a02] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:39.428398 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:39.429118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:39.430511 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:39.431099 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:39.448170 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] HTTP exception thrown: Instance f49ba364-f003-463e-b78e-ced853689a02 could not be found. Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Request method failure captured: Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 HTTP/1.1 Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FdmbsCvaSnbNwnVyq9TBMDsL2DqmfoaRg0XdUW9dyh4-6Dw_6N_m2oas0DV3FqkSa0jUsQNRr6XWfqYCkJzog25VU2igIt8J85jTKqrJzUzaMzoBjovex1KSlWnd_y5HpmXRcIxcW5wYwrSqtiXT1RtSg5f9VwLiX9Upy6PcGeNxP4 Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 9e89f6a32366452592eb5a76f6af57fe Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesNegativeTest-1765029533 Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:45:39.449979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e89f6a32366452592eb5a76f6af57fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e89f6a32366452592eb5a76f6af57fe", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e89f6a32366452592eb5a76f6af57fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e89f6a32366452592eb5a76f6af57fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesNegativeTest-1765029533 Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 9e89f6a32366452592eb5a76f6af57fe Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesNegativeTest-1765029533 Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesNegativeTest-1765029533-project Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: c3c864261ae94460ad72e2c3b709d8e3 Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesNegativeTest-1765029533-project Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance f49ba364-f003-463e-b78e-ced853689a02 could not be found. Aug 01 22:45:39.452618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'f49ba364-f003-463e-b78e-ced853689a02'} Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49ba364-f003-463e-b78e-ced853689a02 could not be found. Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:45:39.454011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49ba364-f003-463e-b78e-ced853689a02 could not be found. Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49ba364-f003-463e-b78e-ced853689a02 could not be found. Aug 01 22:45:39.455895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:45:39.457111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] Returning 404 to user: Instance f49ba364-f003-463e-b78e-ced853689a02 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:45:39.457111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2f52fb66-e404-4bbc-99b0-46db7c646476 tempest-VolumesNegativeTest-1765029533 tempest-VolumesNegativeTest-1765029533-project] 10.222.0.47 "GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02" status: 404 len: 111 microversion: 2.1 time: 0.042494 Aug 01 22:45:39.457111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 167/309] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:39 2022] GET /compute/v2.1/servers/f49ba364-f003-463e-b78e-ced853689a02 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:45:39.540683 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:39.541302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:39.548953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:39.549735 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:39.550741 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:39.551227 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:39.892321 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:39.910218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ae1cf805-adb7-4752-b6a9-9e1340736933 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.373348 Aug 01 22:45:39.912153 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 143/310] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:39 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:39.997824 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:39.998784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:40.013162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:40.014371 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:40.016006 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:40.017021 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:40.374818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:40.404283 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:40.408447 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:40.410680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-46aeb58e-addb-4483-b96c-092640db44fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.420550 Aug 01 22:45:40.411245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:40.411717 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 168/311] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:39 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:40.426475 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:40.450536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:40.451436 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:40.453076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:40.454657 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:40.532537 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-850c9c33-149c-4495-8b1e-93868d5a13d0 req-010041dc-b2a3-4655-b7ea-e639cb044079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466445b3-d5ae-48b0-9bc6-4d29637bc1e1", "tag": "76da36ae-5463-4199-bd52-4734b28cf479"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:40.572299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-850c9c33-149c-4495-8b1e-93868d5a13d0 req-010041dc-b2a3-4655-b7ea-e639cb044079 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:40.573162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-850c9c33-149c-4495-8b1e-93868d5a13d0 req-010041dc-b2a3-4655-b7ea-e639cb044079 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:40.592291 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-850c9c33-149c-4495-8b1e-93868d5a13d0 req-010041dc-b2a3-4655-b7ea-e639cb044079 service nova] Creating event network-changed:76da36ae-5463-4199-bd52-4734b28cf479 for instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 on hv-cinder-85164 Aug 01 22:45:40.613246 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-850c9c33-149c-4495-8b1e-93868d5a13d0 req-010041dc-b2a3-4655-b7ea-e639cb044079 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082366 Aug 01 22:45:40.617628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 169/312] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:45:40.709458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:40.726014 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bf31fdf6-4561-46c2-991b-7937bacd866a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.329010 Aug 01 22:45:40.727419 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 144/313] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:40 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:40.943347 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:40.944225 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:40.964002 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:40.964580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:40.970634 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:40.971449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:41.303435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:41.324341 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-312bb35e-0945-4d34-b093-1e9411d658fe tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.386749 Aug 01 22:45:41.324929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 170/314] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:40 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:41.450769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:41.451897 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:41.464360 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:41.465214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:41.467058 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:41.467826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:41.640046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:41.652892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:41.654475 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:41.655718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0c7737fa-235f-40d6-bbe2-4d27dafbb9cf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.212813 Aug 01 22:45:41.656300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 145/315] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:41 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:41.762110 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:41.763195 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:41.773647 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:41.774574 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:41.775816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:41.776424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:41.995749 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:42.026173 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4bfe8608-bdbf-4a8f-a753-bd2cd297b4e1 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.270159 Aug 01 22:45:42.026961 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 171/316] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:41 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:42.357934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:42.358979 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:42.369546 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:42.370331 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:42.371563 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:42.372326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:42.592892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:42.609705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1a1cf22c-894e-43b7-b440-79b6299f0689 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.253670 Aug 01 22:45:42.609705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 146/317] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:42 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:42.682675 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:42.684448 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:42.692138 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:42.692138 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:42.692848 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:42.693275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:42.876173 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:42.885136 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:42.886672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:42.887945 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9040bc02-c15e-4523-b0ec-bd11290471a3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.212010 Aug 01 22:45:42.888518 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 172/318] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:42 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:43.054181 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:43.055095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:43.063795 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.064307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:43.065267 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.065991 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:43.239843 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-33c970ed-d888-4deb-8753-575ba645ef7b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c2859b8-da14-490a-bcc6-4c6bbf9fa2b0"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:43.246324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:43.249022 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-33c970ed-d888-4deb-8753-575ba645ef7b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:43.256286 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33c970ed-d888-4deb-8753-575ba645ef7b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.257122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33c970ed-d888-4deb-8753-575ba645ef7b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:43.258014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33c970ed-d888-4deb-8753-575ba645ef7b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.258558 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33c970ed-d888-4deb-8753-575ba645ef7b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:43.260784 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-122b2c4d-008b-4512-b7e3-7e9248f86e94 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.211429 Aug 01 22:45:43.261791 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 147/319] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:43 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:43.293616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:43.639262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:43.640799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:43.664104 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.665774 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:43.670806 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.676185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:43.892200 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-33c970ed-d888-4deb-8753-575ba645ef7b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651288 Aug 01 22:45:43.893447 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 173/320] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:45:43 2022] POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:45:43.935093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:43.940260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:43.972107 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.973051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:43.974612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:43.975261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:44.084522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:44.095920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e284c8ba-c57e-4258-ae01-0d45d5e420aa tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.466230 Aug 01 22:45:44.102538 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 148/321] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:43 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:44.283669 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:44.284286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:44.298461 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:44.298981 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:44.299772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:44.300201 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:44.516425 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:44.528071 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f0060696-c248-4f84-9f91-303093efefc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.248203 Aug 01 22:45:44.528812 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 149/322] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:44 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:44.616239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:44.628775 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:44.631129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:44.632897 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4d592d9b-69ed-4fc4-b865-24e9f36152b3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.708639 Aug 01 22:45:44.633934 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 174/323] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:43 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:45.134334 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:45.135112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:45.137525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:45.138295 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:45.146563 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:45.147178 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:45.148189 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:45.148754 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:45.154055 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:45.299502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:45.310028 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5dff2473-5e51-4cbf-bcf0-77d13c314207 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.180077 Aug 01 22:45:45.311454 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 150/324] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:45 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:45.556773 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:45.570619 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:45.572147 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:45.584965 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:45.585551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:45.586631 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:45.587373 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:45.660068 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:45.661079 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:45.711812 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:45.716918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:45.718887 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:45.723897 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:46.052394 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:46.087772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cc228129-3d57-4730-842b-882ecc8292f4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.532384 Aug 01 22:45:46.088810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 175/325] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:45 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:46.172313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-9fa37ba0-90b8-4c9f-9e0b-6fd3474a515e req-3d94ddfb-72da-4751-b263-e5520804c5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466445b3-d5ae-48b0-9bc6-4d29637bc1e1", "name": "network-vif-plugged", "status": "completed", "tag": "76da36ae-5463-4199-bd52-4734b28cf479"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:45:46.184707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:46.200835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:46.203273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:46.205329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-71f67f7f-36c9-4bbb-9ae7-5aa8e7dc3ac7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.551634 Aug 01 22:45:46.206900 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 151/326] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:45 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:46.211096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-9fa37ba0-90b8-4c9f-9e0b-6fd3474a515e req-3d94ddfb-72da-4751-b263-e5520804c5ab service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:46.220198 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-9fa37ba0-90b8-4c9f-9e0b-6fd3474a515e req-3d94ddfb-72da-4751-b263-e5520804c5ab service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:46.298972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-9fa37ba0-90b8-4c9f-9e0b-6fd3474a515e req-3d94ddfb-72da-4751-b263-e5520804c5ab service nova] Creating event network-vif-plugged:76da36ae-5463-4199-bd52-4734b28cf479 for instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 on hv-cinder-85164 Aug 01 22:45:46.316423 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-9fa37ba0-90b8-4c9f-9e0b-6fd3474a515e req-3d94ddfb-72da-4751-b263-e5520804c5ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151775 Aug 01 22:45:46.317415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 176/327] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:45:46.342018 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:46.346483 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:46.363649 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:46.370654 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:46.371970 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:46.372699 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:46.693294 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:46.709934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f2ebf178-76ea-480b-8a61-e600b8af055a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.381146 Aug 01 22:45:46.710680 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 152/328] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:46 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:47.128197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:47.135600 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:47.147054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:47.147783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:47.149192 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:47.149959 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:47.241855 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:47.244271 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:47.272284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:47.275339 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:47.277945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:47.280299 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:47.634123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:47.675501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:47.681166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:47.692372 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f913f393-c52e-4b7a-bdf7-ac1d09425735 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.457209 Aug 01 22:45:47.694108 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 153/329] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:47 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:47.738053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:47.739070 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:47.764814 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:47.766565 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:47.768587 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:47.769541 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:47.919465 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:47.936693 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-73ad4bd6-078e-46bc-902e-f55c7ea821ea tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.824946 Aug 01 22:45:47.938852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 177/330] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:47 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:48.140956 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:48.153165 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d1a35443-3b23-4611-975e-c461bb7da540 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.424599 Aug 01 22:45:48.154218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 154/331] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:47 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:48.730949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:48.731708 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:48.740880 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:48.741325 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:48.746203 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:48.746914 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:48.981680 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:48.987756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:48.996150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:48.997196 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:49.016590 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:49.018584 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:49.049732 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:49.059640 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:49.061451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:49.063171 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4c818819-3cbf-465d-8d9a-62588fb4225f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.338986 Aug 01 22:45:49.064353 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 178/332] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:48 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:49.176758 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:49.177695 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:49.185892 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:49.186337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:49.187114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:49.187683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:49.361915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:49.370524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-de5df4c5-1854-4210-ad94-d0d41d50c125 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.197453 Aug 01 22:45:49.371118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 179/333] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:49 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:49.564106 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:49.572423 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-38d0e3ea-4506-43fb-9866-a5abcf8ee54d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.607001 Aug 01 22:45:49.573198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 155/334] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:48 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:50.103519 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:50.104724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:50.119609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:50.120232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:50.121375 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:50.122107 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:50.391967 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:50.393273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:50.400551 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:50.401257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:50.405266 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:50.409056 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:50.414064 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:50.414939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:50.423118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:50.428320 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-93c3fdd1-18b6-40a0-94ad-b7aa86420956 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.330768 Aug 01 22:45:50.430021 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 180/335] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:50 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:50.598995 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:50.599877 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:50.606811 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:50.607587 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:50.608375 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:50.608963 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:50.696498 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:50.705495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-637d271c-03ea-4279-ab63-54e1e1fc9c28 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1313 microversion: 2.1 time: 0.317465 Aug 01 22:45:50.717108 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 156/336] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:50 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:50.771241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:50.780706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-70354453-2536-495c-b696-d323f37c3c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.185565 Aug 01 22:45:50.781670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 181/337] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:50 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:51.456503 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:51.457847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:51.471525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:51.472638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:51.474246 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:51.475710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:51.730253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:51.732898 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:51.747878 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:51.749275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:51.751574 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:51.752820 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:51.823423 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:51.839896 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:51.844074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:51.848407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f1ed29b7-ad83-411b-a776-2e58dd615a93 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.398465 Aug 01 22:45:51.849919 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 157/338] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:51 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:51.871099 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:51.873125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:51.880553 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:51.881012 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:51.881876 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:51.893980 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:52.084172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:52.122023 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-51cea53c-cbc8-432e-8a66-389e3ae1b97a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1497 microversion: 2.1 time: 0.397275 Aug 01 22:45:52.122666 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 182/339] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:51 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1497 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:52.242298 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:52.255031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0b7ca4dd-ecfa-4204-81c1-316f818adf17 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.387313 Aug 01 22:45:52.256053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 158/340] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:51 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:52.879490 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:52.881171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:52.882554 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:52.883339 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:52.908151 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:52.908599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:52.909407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:52.909866 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:52.913259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:52.913906 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:52.915099 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:52.915719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:52.970938 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:45:53.117765 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-01cd77d3-d9d3-4f93-99cd-3254c37b42cd tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "DELETE /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 204 len: 0 microversion: 2.1 time: 0.251824 Aug 01 22:45:53.119309 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 183/341] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:45:52 2022] DELETE /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:45:53.137067 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:53.138718 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:53.147447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:53.152304 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:53.153331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:53.154978 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:53.155877 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:53.156282 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:53.157379 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:53.158591 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-fe061d12-bc0c-40b6-8cf1-9860a0ffac57 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.289495 Aug 01 22:45:53.159155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 159/342] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:52 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:53.284075 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:53.285295 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:53.298196 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:53.298823 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:53.299685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:53.303385 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:53.393381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:53.402183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c95cc3d0-dbf4-414b-b5b9-f6da58504924 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1503 microversion: 2.1 time: 0.274323 Aug 01 22:45:53.403352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 184/343] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:53 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:53.517809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:53.529054 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8513bb3c-50e3-47df-bc09-141cd084c828 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.251412 Aug 01 22:45:53.530164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 160/344] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:53 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:54.184957 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:54.185709 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:54.197688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:54.198025 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:54.200750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:54.202887 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:54.425775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:54.426931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:54.439723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:54.440231 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:54.441069 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:54.441594 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:54.499796 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:54.514780 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:54.517604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:54.519334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-91b647ef-cf50-433d-80e0-38a553abf2d1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.339990 Aug 01 22:45:54.520570 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 185/345] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:54 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:54.568202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:54.569067 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:54.583950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:54.585197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:54.591241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:54.592475 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:54.880136 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:54.907675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b2801cfe-0695-42bb-9d32-3a4679df873a tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1503 microversion: 2.1 time: 0.486034 Aug 01 22:45:54.908755 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 161/346] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:54 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1503 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:55.032326 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:55.052160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-16220023-c0a4-45f2-babc-9e17f41bc2f8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.477346 Aug 01 22:45:55.054346 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 186/347] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:54 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:55.542840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:55.544190 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:55.555406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:55.556140 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:55.558971 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:55.559655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:55.946913 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:55.947725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:55.966061 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:55.968840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:55.969923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:55.971107 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:56.035045 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:45:56.199549 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:56.215203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:56.217504 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:56.219101 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-de5a89d4-affd-4948-bb8c-367e3459e9b6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.680414 Aug 01 22:45:56.250360 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 162/348] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:55 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:56.263297 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:56.264820 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:56.280112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:56.284261 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:56.285602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:56.287321 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:56.323233 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:56.336275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8ada707a-a739-46f2-a202-0eef0895378d tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1503 microversion: 2.1 time: 0.393405 Aug 01 22:45:56.338465 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 187/349] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:55 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:56.640319 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:56.650345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f499f323-9d0c-4df1-940a-29e93a6af2ce tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.398241 Aug 01 22:45:56.650939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 163/350] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:56 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:57.252267 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:57.252940 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:57.278317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:57.278317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:57.278317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:57.278317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:57.362397 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:57.363535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:57.376466 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:57.381880 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:57.384103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:57.387565 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:57.552919 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:57.563723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:57.566092 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:57.569542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0f689c63-f959-40fc-b832-240860bef3c7 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.328532 Aug 01 22:45:57.570734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 188/351] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:57 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:57.675632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:57.676767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:57.691027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:57.691747 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:57.692788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:57.693451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:57.994951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:58.016255 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7b525715-38a4-42d7-bc80-4a32e8a61d00 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.345092 Aug 01 22:45:58.031872 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 189/352] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:57 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:45:58.096398 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:58.111434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b68d15c3-7cf5-4380-af39-4804eb39f1ca tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1503 microversion: 2.1 time: 0.755306 Aug 01 22:45:58.127084 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 164/353] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:57 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1503 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:58.606500 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:58.607105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:58.614117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:58.615020 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:58.615967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:58.616556 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:58.884297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:58.894856 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:58.896739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:58.898319 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b0424ff4-ef90-45be-9dd5-270b74583f4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.296114 Aug 01 22:45:58.914153 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 190/354] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:58 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:45:59.056874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:59.059698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:59.068643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:59.071685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:59.073893 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:59.074607 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:59.137016 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:59.138032 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:59.188182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:59.197760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:59.200132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:59.201128 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:59.630289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:59.648896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-62a45fd8-b2da-4fb8-bff2-cab3811c26ee tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1503 microversion: 2.1 time: 0.518904 Aug 01 22:45:59.651499 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 191/355] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:59 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1503 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:59.783119 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:45:59.795324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-afc810db-1932-4b7e-a9a1-0682e0bca784 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.746564 Aug 01 22:45:59.811886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 165/356] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:45:59 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:45:59.933504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:45:59.935361 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:45:59.949057 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:59.949522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:45:59.950368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:45:59.951542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:00.339852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:00.356491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:00.358684 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:00.360104 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-162b3ad9-d6dd-47d7-bd46-dd8243de6234 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1745 microversion: 2.20 time: 0.436150 Aug 01 22:46:00.374240 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 192/357] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:45:59 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1745 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:00.673100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:00.674099 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:00.689624 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:00.690458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:00.692859 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:00.694331 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:00.816645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:00.817250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:00.831465 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:00.834075 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:00.838008 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:00.839092 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:00.989440 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:00.993173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:00.999106 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4e821532-d62a-4c48-b1bb-111945c90aa1 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1503 microversion: 2.1 time: 0.331975 Aug 01 22:46:01.023241 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 166/358] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:00 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:01.081852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:01.092252 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-275471fe-4d47-4ff6-aa62-d206785b4df9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.279582 Aug 01 22:46:01.096590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 193/359] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:00 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:01.394996 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:01.395622 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:01.414369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:01.415408 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:01.419453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:01.422723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:01.888207 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-06ba2abb-b82b-4d35-a3e6-7c6d80b466a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:01.908828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-06ba2abb-b82b-4d35-a3e6-7c6d80b466a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:01.909594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-06ba2abb-b82b-4d35-a3e6-7c6d80b466a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.065621 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:02.090123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:02.096008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:02.100219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-773bf0b2-fcf1-4f5c-bb3c-4e1ed3b5561d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1745 microversion: 2.20 time: 0.712612 Aug 01 22:46:02.113615 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 167/360] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:01 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1745 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:02.114085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-06ba2abb-b82b-4d35-a3e6-7c6d80b466a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Going to try to stop instance {{(pid=124358) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 22:46:02.141198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:02.142245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:02.159838 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:02.166540 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.167830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.171580 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.172972 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.266003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-06ba2abb-b82b-4d35-a3e6-7c6d80b466a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action" status: 202 len: 0 microversion: 2.1 time: 0.383028 Aug 01 22:46:02.268181 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 194/361] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:46:01 2022] POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 22:46:02.312473 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:02.313776 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:02.336114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.337706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.343058 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.343713 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:02.344707 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.355641 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-02913157-3b5d-4b42-b8f2-e56621305514 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1461 microversion: 2.1 time: 0.252399 Aug 01 22:46:02.356588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 168/362] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:02 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1461 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:02.368086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-dea8256c-898a-4bbe-bbb0-627c2f2ee920 req-38bda211-be03-4674-8cb2-ec55fda89e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466445b3-d5ae-48b0-9bc6-4d29637bc1e1", "name": "network-vif-deleted", "tag": "76da36ae-5463-4199-bd52-4734b28cf479"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:02.394818 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-dea8256c-898a-4bbe-bbb0-627c2f2ee920 req-38bda211-be03-4674-8cb2-ec55fda89e72 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.395566 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-dea8256c-898a-4bbe-bbb0-627c2f2ee920 req-38bda211-be03-4674-8cb2-ec55fda89e72 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.419598 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-dea8256c-898a-4bbe-bbb0-627c2f2ee920 req-38bda211-be03-4674-8cb2-ec55fda89e72 service nova] Creating event network-vif-deleted:76da36ae-5463-4199-bd52-4734b28cf479 for instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 on hv-cinder-85164 Aug 01 22:46:02.432303 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-dea8256c-898a-4bbe-bbb0-627c2f2ee920 req-38bda211-be03-4674-8cb2-ec55fda89e72 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068132 Aug 01 22:46:02.438794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 169/363] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:02.445421 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:02.461753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:02.469989 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.470950 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.472061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.472535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.648144 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:02.659001 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-579d8f87-7e6f-4e53-92a1-d9566bca3553 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.383766 Aug 01 22:46:02.659994 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 195/364] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:02 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:02.752997 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-063c0a52-4d5d-440d-b3fe-aa7e7b6eb988 req-1217f31b-8f76-4b90-b06a-ca8c45bf07b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d", "name": "network-vif-plugged", "status": "completed", "tag": "0910ddf7-1491-401d-8e5a-8a12e83a6b3f"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:02.781923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-063c0a52-4d5d-440d-b3fe-aa7e7b6eb988 req-1217f31b-8f76-4b90-b06a-ca8c45bf07b2 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:02.784694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-063c0a52-4d5d-440d-b3fe-aa7e7b6eb988 req-1217f31b-8f76-4b90-b06a-ca8c45bf07b2 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:02.807536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-063c0a52-4d5d-440d-b3fe-aa7e7b6eb988 req-1217f31b-8f76-4b90-b06a-ca8c45bf07b2 service nova] Creating event network-vif-plugged:0910ddf7-1491-401d-8e5a-8a12e83a6b3f for instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d on hv-cinder-85164 Aug 01 22:46:02.816309 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-063c0a52-4d5d-440d-b3fe-aa7e7b6eb988 req-1217f31b-8f76-4b90-b06a-ca8c45bf07b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076087 Aug 01 22:46:02.818540 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 196/365] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:02.856108 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:02.867448 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e3cbc0b0-a5c6-4f88-bde9-e4cfe55f94cb tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.426900 Aug 01 22:46:02.881773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 170/366] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:02 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:03.139773 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1988f53c-d615-4dfd-9471-46ebe47940b7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Action: 'create', calling method: .version_select at 0x7fc541ab0c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1274276978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/M82w5d/RYOcD/2ZqXgTmQYpt9BCMlKMczhWpZDk65jnUOu5avCNtn85cnRNacZyc1N9meR4WqjW8WJXj0zcgEx1ezIq1ZZxth2LSVRYUI0YkPD+gFz00V2ZnFA+xwhQ=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:03.144318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:03.145411 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:03.161046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.161046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.167014 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.167594 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.178885 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-1988f53c-d615-4dfd-9471-46ebe47940b7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Getting quotas for project dcf006ee932d483b9cb06f83b7b86b47. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:46:03.199333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-1988f53c-d615-4dfd-9471-46ebe47940b7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Getting quotas for user bdfea4c2f4f94cec9cabde2c7822b9a9 and project dcf006ee932d483b9cb06f83b7b86b47. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:46:03.312804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1988f53c-d615-4dfd-9471-46ebe47940b7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.491606 Aug 01 22:46:03.350555 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 197/367] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:46:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:03.398431 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:03.399314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:03.423629 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.430361 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.432273 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.439488 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.504707 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.505377 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.506086 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lazy-loading 'fault' on Instance uuid 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:46:03.564251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:03.571714 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:03.580907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:03.583350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:03.584048 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-50ebdb00-2d55-46dc-b00a-6bb9961553c8 tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1303 microversion: 2.1 time: 0.192710 Aug 01 22:46:03.584865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 198/368] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:03 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:03.585077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-87e70bb3-b0c6-43db-a7e3-d0e6123c45e2 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1745 microversion: 2.20 time: 0.459198 Aug 01 22:46:03.585781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 171/369] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:03 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1745 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:03.692404 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:03.695637 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:03.722261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.723179 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.724688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.725494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.893787 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:03.894703 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:03.928190 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.929112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:03.930404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:03.931038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:04.080372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:04.104247 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e5004f4a-5923-4933-ac84-13a9898494bc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.419436 Aug 01 22:46:04.105391 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 199/370] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:03 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:04.616147 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:04.616816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:04.633259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:04.634196 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:04.661703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:04.661703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:04.781652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:04.847623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e82a02de-eb06-4f92-acae-ae589167df88 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.952355 Aug 01 22:46:04.849676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 172/371] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:03 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:04.894557 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:04.896523 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:04.941514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:04.942008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:04.942849 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:04.943356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:04.983959 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:05.014299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:05.019619 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:05.020821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d1f2eb08-dbc3-49df-b3a3-d52a841c82c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1745 microversion: 2.20 time: 0.411627 Aug 01 22:46:05.021379 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 200/372] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:04 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1745 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:05.102481 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.104602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.105855 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lazy-loading 'fault' on Instance uuid 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:46:05.136819 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:05.137427 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:05.147884 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.148335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.153532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.154012 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.179033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26c501f3361e46239a6a492d0858afe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6c81f84dac4d9cafa3908a5896ae24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:05.189407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2d68f574-fa87-40a5-a11c-d633fc38627c tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 200 len: 1303 microversion: 2.1 time: 0.337209 Aug 01 22:46:05.192369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 173/373] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:04 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 1303 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:05.471388 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:05.480504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bf261b8f-2275-4c88-93c2-7fc57bbed203 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1503 microversion: 2.1 time: 0.347268 Aug 01 22:46:05.481658 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 201/374] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:05 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:05.503662 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f10228-aed7-4cd6-9c67-dc27cd863fd1"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:05.506735 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:05.514795 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.515429 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.516758 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.517358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.548554 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] HTTP exception thrown: Cannot 'attach_volume' instance b370cbad-46b8-4418-9b13-b7158495237c while it is in vm_state rescued Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Request method failure captured: Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: POST /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c/os-volume_attachments HTTP/1.1 Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 74 Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcFvf4aw_URmCUfiD67OVb-quybPOxELhtN9IfD7JvucjoqvMa7hcXurP0YYYB2IjO-LZ4mOypyLc0KDCM5Zw-dKimkoPzcfQWwHVRp6lWGSpEwbTlR4xmzyg1YDu_GrlBa30tR-aXXhWO97gf_LgUMmGqk-dNxSaBsn7DHf2A1kjI Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:46:05.551007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a6afb01194249d6af1c369e9f109b72", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: a8bbeb0e65a54b1199d0fe718168af70 Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {"volumeAttachment": {"volumeId": "00f10228-aed7-4cd6-9c67-dc27cd863fd1"}} Aug 01 22:46:05.552625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Cannot 'attach_volume' instance b370cbad-46b8-4418-9b13-b7158495237c while it is in vm_state rescued Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'server_id': 'b370cbad-46b8-4418-9b13-b7158495237c', 'body': {'volumeAttachment': {'volumeId': '00f10228-aed7-4cd6-9c67-dc27cd863fd1'}}} Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b370cbad-46b8-4418-9b13-b7158495237c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:46:05.553592 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b370cbad-46b8-4418-9b13-b7158495237c while it is in vm_state rescued Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:46:05.555043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:46:05.556477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:46:05.556477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:46:05.556477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b370cbad-46b8-4418-9b13-b7158495237c while it is in vm_state rescued Aug 01 22:46:05.556477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:05.558389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Returning 409 to user: Cannot 'attach_volume' instance b370cbad-46b8-4418-9b13-b7158495237c while it is in vm_state rescued {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:46:05.559640 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-15fad415-7628-4700-ac0d-d8f72b3d4a0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060806 Aug 01 22:46:05.564301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 174/375] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:46:05 2022] POST /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 22:46:05.578274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-42de3a5d-d3cd-4c2b-b294-870549f4ce8c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:05.580271 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-42de3a5d-d3cd-4c2b-b294-870549f4ce8c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:05.603131 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42de3a5d-d3cd-4c2b-b294-870549f4ce8c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.604359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42de3a5d-d3cd-4c2b-b294-870549f4ce8c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.606245 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42de3a5d-d3cd-4c2b-b294-870549f4ce8c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.607569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42de3a5d-d3cd-4c2b-b294-870549f4ce8c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.758372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-42de3a5d-d3cd-4c2b-b294-870549f4ce8c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c/action" status: 202 len: 0 microversion: 2.1 time: 0.191844 Aug 01 22:46:05.760264 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 202/376] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:46:05 2022] POST /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:46:05.772326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:05.772944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:05.781440 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.781926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.783401 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.784000 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.885482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:05.886464 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:05.897010 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.899261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.900510 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:05.903129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:05.959574 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:06.057924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:06.067628 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a2e7c05a-701a-49b2-886a-ebbd055dd8fb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1511 microversion: 2.1 time: 0.300279 Aug 01 22:46:06.068458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 175/377] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:05 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:06.074252 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:06.075127 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:06.085758 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:06.086696 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:06.087965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:06.088568 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:06.494262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:06.514378 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:06.515561 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:06.518656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-62c21975-2614-4611-bc39-c8dc918d2986 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.448965 Aug 01 22:46:06.519832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 176/378] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:06 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:06.524890 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:06.526206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] [instance: 466445b3-d5ae-48b0-9bc6-4d29637bc1e1] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:06.544628 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:06.545587 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:06.546762 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:06.547425 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:06.564824 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] HTTP exception thrown: Instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 could not be found. Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Request method failure captured: Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 HTTP/1.1 Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fdchc33dGXXCnPj0zW4stQSgDjhz5dG29IPv8yQJ7tRI803lFej6iLD77M2aZGcMforKAJYpf0A_DruvpX4CqQCuSDlpdLnSxdWNjrV6PO3p6Km8a4US8EqfkR2d3pi0l7xLKpCd78RzgcIPsXzUqu44C5E6S9gCDK86QiNpWc8SPg Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 3e6c81f84dac4d9cafa3908a5896ae24 Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesActionsTest-1919304832 Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:46:06.567182 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e6c81f84dac4d9cafa3908a5896ae24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3e6c81f84dac4d9cafa3908a5896ae24", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3e6c81f84dac4d9cafa3908a5896ae24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e6c81f84dac4d9cafa3908a5896ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesActionsTest-1919304832 Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 3e6c81f84dac4d9cafa3908a5896ae24 Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesActionsTest-1919304832 Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesActionsTest-1919304832-project Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 26c501f3361e46239a6a492d0858afe2 Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesActionsTest-1919304832-project Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 could not be found. Aug 01 22:46:06.568452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '466445b3-d5ae-48b0-9bc6-4d29637bc1e1'} Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 could not be found. Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:46:06.569186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 could not be found. Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 could not be found. Aug 01 22:46:06.570819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:46:06.573240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] Returning 404 to user: Instance 466445b3-d5ae-48b0-9bc6-4d29637bc1e1 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:46:06.575336 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-008bd1d6-6f84-475f-96f1-1848f9e90b4b tempest-VolumesActionsTest-1919304832 tempest-VolumesActionsTest-1919304832-project] 10.222.0.47 "GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1" status: 404 len: 111 microversion: 2.1 time: 0.053394 Aug 01 22:46:06.576707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 177/379] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:06 2022] GET /compute/v2.1/servers/466445b3-d5ae-48b0-9bc6-4d29637bc1e1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:46:06.641781 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:06.674863 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b4078e2a-a798-43f6-8e6d-ce16885bc16a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.791538 Aug 01 22:46:06.680421 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 203/380] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:05 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:07.096473 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:07.097577 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:07.111524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:07.118458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:07.124095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:07.124797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:07.413948 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:07.428683 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5691508e-ddfa-4a16-8874-9fe0a6829da3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1511 microversion: 2.1 time: 0.340261 Aug 01 22:46:07.445895 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 178/381] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:07 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:07.559855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:07.562272 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:07.600437 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:07.601415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:07.603486 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:07.604815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:07.710678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:07.711293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:07.722009 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:07.722461 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:07.723235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:07.723660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:07.970597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:07.990719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:08.002101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:08.003562 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-49e82556-b7d7-4c2e-aed8-c2788cab38c5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.455539 Aug 01 22:46:08.009054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 204/382] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:07 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:08.266663 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:08.278947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-45b026a4-4f72-4341-b871-3d931d71ca0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.572939 Aug 01 22:46:08.281140 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 179/383] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:07 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:08.455596 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:08.457515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:08.486460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:08.487452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:08.490172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:08.491848 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:08.893948 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:08.908870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-56706901-cc33-43b9-82c8-08981d43d1cb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1511 microversion: 2.1 time: 0.457053 Aug 01 22:46:08.910527 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 205/384] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:08 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:09.044255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:09.044871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:09.057617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:09.058066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:09.058858 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:09.059363 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:09.309903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:09.313607 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:09.320711 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:09.321767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:09.331207 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:09.332053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:09.333534 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:09.334308 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:09.354068 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:09.359356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:09.364044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9bcbf315-5776-4e2e-bdf1-409368f9a632 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.325818 Aug 01 22:46:09.383678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 180/385] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:09 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:09.757923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:09.781959 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e522f456-4ace-4a27-8ed4-aaf04e279ff1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.482407 Aug 01 22:46:09.783714 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 206/386] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:09 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:09.936939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:09.937788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:09.958926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:09.959802 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:09.960659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:09.966771 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:10.351409 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:10.368828 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-61887f73-2194-4faf-a788-06c882b32fba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1511 microversion: 2.1 time: 0.436537 Aug 01 22:46:10.370432 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 181/387] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:09 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:10.396628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:10.397757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:10.409944 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:10.410622 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:10.415011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:10.416370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:10.734370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:10.753450 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:10.755422 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:10.756665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e5f63261-ce6c-4494-ba88-2caf1f9d8329 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.367641 Aug 01 22:46:10.757331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 207/388] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:10 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:10.841513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:10.842762 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:10.853338 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:10.854449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:10.855835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:10.856464 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:11.151087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:11.176096 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b4378f2b-31d4-487b-b881-a827f0567959 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.343984 Aug 01 22:46:11.190487 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 182/389] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:10 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:11.400731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:11.406249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:11.458505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:11.469541 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:11.473977 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:11.474807 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:11.781213 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:11.782170 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:11.787941 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:11.795727 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5f9411e6-4de7-4819-b895-cd7b81bf09e0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1517 microversion: 2.1 time: 0.402879 Aug 01 22:46:11.797468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 208/390] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:11 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1517 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:11.801160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:11.802066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:11.805055 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:11.807526 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:12.092002 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:12.116203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:12.119823 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:12.122080 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b20f6823-ea63-496c-86eb-d561cac69054 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.345417 Aug 01 22:46:12.144526 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 183/391] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:11 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:12.257256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:12.258842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:12.268899 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:12.270227 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:12.271914 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:12.273929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:12.719816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:12.729786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-01be8de0-db0b-4ba2-af24-0685c2bf173f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.481646 Aug 01 22:46:12.730646 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 209/392] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:12 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:13.151036 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:13.151995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:13.164077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:13.167282 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:13.168509 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:13.168982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:13.438457 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:13.443919 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:13.462544 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:13.464995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:13.466718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1256e982-9379-49d9-9002-ea1bb261b145 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.319381 Aug 01 22:46:13.467360 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 184/393] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:13 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:13.767305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:13.768322 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:13.770946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=4 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:13.771508 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2c9dd1be-2bf5-41d3-bc1c-0e60f8f7bdd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'create', calling method: .version_select at 0x7fc5424f8700>, body: {"keypair": {"name": "tempest-keypair-925472378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRhBWuVctTLbyCfByslpO2r51fCbFs4VwM0pNBTHRvd+5B02UKHPwldCaHiitTyMEhN1MPZdvw7yzZfjMrF05WSFQG+YptP/UTXTWeeRNXFQLu8L7fluASJRuIwI4GLjg=="}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:13.785892 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:13.795203 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:13.799133 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:13.799656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-2c9dd1be-2bf5-41d3-bc1c-0e60f8f7bdd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for project 6a6afb01194249d6af1c369e9f109b72. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:46:13.800272 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:13.805274 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-2c9dd1be-2bf5-41d3-bc1c-0e60f8f7bdd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for user a8bbeb0e65a54b1199d0fe718168af70 and project 6a6afb01194249d6af1c369e9f109b72. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:46:13.886669 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2c9dd1be-2bf5-41d3-bc1c-0e60f8f7bdd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119319 Aug 01 22:46:13.888481 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 185/394] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:46:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:14.104850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:14.147967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-74f8f686-7c37-4b93-acce-b07149a72dc5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.384133 Aug 01 22:46:14.153243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 210/395] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:13 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:14.511307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:14.512147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:14.525366 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:14.526515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:14.527982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:14.528730 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:15.087895 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:15.108760 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:15.115206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:15.124626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1472b2b7-7c0d-4509-b9d6-89dcd74b8c60 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.620407 Aug 01 22:46:15.125288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 186/396] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:14 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:15.178802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:15.179395 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:15.188931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:15.189377 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:15.190468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:15.191091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:15.423955 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:15.445928 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-66e8e6f7-8b43-4430-9322-a0e9ff63d00a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.270046 Aug 01 22:46:15.448555 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 211/397] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:15 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:16.156907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:16.157668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:16.177099 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:16.177543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:16.178350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:16.178803 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:16.481505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:16.483572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:16.501506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:16.502241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:16.503169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:16.503745 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:16.574110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:16.607766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:16.615438 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:16.625345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e1573c70-4b28-4650-8043-7646380f556b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.468880 Aug 01 22:46:16.645343 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 187/398] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:16 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:16.733037 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:16.761979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fb80b1e8-c039-42bb-842b-21bd54f203ee tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.284956 Aug 01 22:46:16.763929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 212/399] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:16 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:17.119779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-45909741", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bee37cf-5a4d-4797-a16f-d959b4b59227"}], "security_groups": [{"name": "tempest-securitygroup--1192899072"}], "key_name": "tempest-keypair-925472378", "user_data": "}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:17.660969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:17.663182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:17.696267 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:17.697091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:17.709582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:17.715590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:18.050367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:18.066209 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:18.068167 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:18.069680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-85e21f04-a8d8-45d3-b962-fb04f295ee76 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.416862 Aug 01 22:46:18.071604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 213/400] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:17 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:18.079586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:18.081016 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:18.092055 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:18.093474 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:18.094933 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:18.095969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:18.312251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:18.329529 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fac015e3-36b5-48ba-8863-344be92493c4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1722 microversion: 2.1 time: 0.255730 Aug 01 22:46:18.330176 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 214/401] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:18 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:19.106834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:19.109069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:19.115580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:19.116242 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:19.117164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:19.117868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:19.352804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:19.363582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:19.366299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:19.369359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cff1cfb9-5921-40ec-a4ba-9ae799873c8e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.267840 Aug 01 22:46:19.370611 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 215/402] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:19 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:19.375996 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:19.376835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:19.385901 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:19.386524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:19.387602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:19.388133 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:19.603682 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:19.614596 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-19ec09e1-4e68-49f1-a697-c132217837b1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1699 microversion: 2.1 time: 0.242699 Aug 01 22:46:19.615753 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 216/403] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:19 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1699 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:19.652717 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-78752deb-e9ef-4c08-ab24-c2790510b7f7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:19.662037 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78752deb-e9ef-4c08-ab24-c2790510b7f7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:19.662983 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78752deb-e9ef-4c08-ab24-c2790510b7f7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:19.702796 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-78752deb-e9ef-4c08-ab24-c2790510b7f7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Going to try to start instance {{(pid=124358) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 22:46:19.795768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-78752deb-e9ef-4c08-ab24-c2790510b7f7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action" status: 202 len: 0 microversion: 2.1 time: 0.154616 Aug 01 22:46:19.796760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 217/404] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:46:19 2022] POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:46:19.817538 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:19.819024 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:19.834219 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:19.835989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:19.837215 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:19.838019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:20.209751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:20.231588 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e870b418-69c0-42e7-8f2f-efb394c392a6 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1708 microversion: 2.1 time: 0.429783 Aug 01 22:46:20.246011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 218/405] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:19 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1708 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:20.251213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-604481326", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "networks": [{"uuid": "8e01b47c-dc86-4c4c-ade8-c4465ce4dc0c"}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:21.656639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] validate_networks() for [('8e01b47c-dc86-4c4c-ade8-c4465ce4dc0c', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:46:21.736670 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] validate_networks() for [('5bee37cf-5a4d-4797-a16f-d959b4b59227', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:46:22.292053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:46:22.300308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:46:22.301044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:46:22.302005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:46:22.302900 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:46:22.318869 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.319649 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.321194 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.322024 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.353165 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for project 6a6afb01194249d6af1c369e9f109b72. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:46:22.360544 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Getting quotas for user a8bbeb0e65a54b1199d0fe718168af70 and project 6a6afb01194249d6af1c369e9f109b72. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:46:22.382513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:46:22.387033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:46:22.435830 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:46:22.436329 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:46:22.436827 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:46:22.437235 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:46:22.437681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:46:22.448316 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.448763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.449596 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.450147 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.456583 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:22.468183 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e49269f8-70ec-4af5-83f2-6434e84fff2a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.352782 Aug 01 22:46:22.479121 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 188/406] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:46:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 5354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:46:22.479454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Getting quotas for project 3b04d30f1426408ba5c8fa0238982089. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:46:22.479639 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:22.479639 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:22.479937 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Getting quotas for user c362f3a63b944fbcbea080d55c8fdfa1 and project 3b04d30f1426408ba5c8fa0238982089. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:46:22.486926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.487514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.488575 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.488883 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.498444 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:46:22.503651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:46:22.573180 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f245a1d6-310f-42a3-8d5b-0872e5f6d365 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.325844 Aug 01 22:46:22.574854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 219/407] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:46:22.583066 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:22.584070 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:22.594174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.595030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.595819 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:22.596251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:22.692972 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:22.709456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:22.712585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:22.715339 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7df73da0-94b8-4d4d-967a-98bc93ac488d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.244952 Aug 01 22:46:22.717290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 189/408] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:22 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:22.725631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-78d3e4dc-0c92-4792-9cfc-2a8140b1088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:22.726881 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-78d3e4dc-0c92-4792-9cfc-2a8140b1088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:22.808729 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:22.810171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-78d3e4dc-0c92-4792-9cfc-2a8140b1088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:22.820908 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-78d3e4dc-0c92-4792-9cfc-2a8140b1088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1243 microversion: 2.1 time: 0.101725 Aug 01 22:46:22.821939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 190/409] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:22 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1243 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:22.830613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6c6a9bb1-907f-489a-914e-49feeee37dd7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:22.830993 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6eadd64d-96ea-43ec-89f9-556c4d580f07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1708 microversion: 2.1 time: 0.253474 Aug 01 22:46:22.832238 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6c6a9bb1-907f-489a-914e-49feeee37dd7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:22.839799 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 220/410] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:22 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1708 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:22.935617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6c6a9bb1-907f-489a-914e-49feeee37dd7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:22.953186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6c6a9bb1-907f-489a-914e-49feeee37dd7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1218 microversion: 2.1 time: 0.129135 Aug 01 22:46:22.954402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 191/411] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:22 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:23.740625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:23.741253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:23.748485 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.748923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:23.749717 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.750143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:23.856451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:23.857199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:23.863572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.864043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:23.864805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.865237 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:23.887902 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:23.896205 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:23.897702 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:23.898856 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-deab1301-f2b7-44f8-a18e-556afd854e51 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.162248 Aug 01 22:46:23.899466 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 221/412] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:23 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:23.903947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:23.904544 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:23.910784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.911228 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:23.911987 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.912411 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:23.942417 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:23.950296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-392d33e4-a284-4a07-b27f-35143f32cc6c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1247 microversion: 2.1 time: 0.097787 Aug 01 22:46:23.950889 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 192/413] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:23 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:23.985938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:23.986578 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:23.992902 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.993345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:23.994147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:23.994584 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:24.056631 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:24.060922 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:24.065241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1af6a757-14f8-4e32-8c23-9bbf811373e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1708 microversion: 2.1 time: 0.164696 Aug 01 22:46:24.065834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 222/414] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:23 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:24.068785 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bc20d1ee-bc10-4aeb-88f4-154b8e60acc6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1222 microversion: 2.1 time: 0.087039 Aug 01 22:46:24.069326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 193/415] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:23 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:24.933448 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:24.934079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:24.941023 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:24.941487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:24.942286 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:24.942720 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:24.975529 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:24.976557 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:24.984941 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:24.985431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:24.986212 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:24.986647 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:25.053710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:25.066513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-44327f05-d42d-4fa9-8aa7-6969ee228803 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1247 microversion: 2.1 time: 0.097369 Aug 01 22:46:25.067452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 194/416] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:24 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1247 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:25.093931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:25.095362 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:25.104254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:25.104845 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:25.105638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:25.106076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:25.118435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:25.127464 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:25.128973 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:25.130175 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-93c37b1d-c9a6-4018-8de8-fe6855672645 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1740 microversion: 2.20 time: 0.200759 Aug 01 22:46:25.130743 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 223/417] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:24 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:25.135329 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:25.136256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:25.142976 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:25.143751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:25.144768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:25.145415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:25.214806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:25.223546 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aa3a1d18-f7b8-4079-8ab0-c28b1c94705d tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1222 microversion: 2.1 time: 0.091709 Aug 01 22:46:25.224117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 224/418] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:25 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:25.256235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:25.265063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8d77daf7-35a3-441b-9a30-f3c51660c7d3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1708 microversion: 2.1 time: 0.179015 Aug 01 22:46:25.265700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 195/419] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:25 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:26.089315 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:26.089971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:26.101333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.102783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.105175 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.107254 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.166385 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:26.168427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:26.180260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.181275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.183012 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.183793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.228063 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:26.247894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b6e0c1af-45a6-40d2-8353-f29b4565594b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1239 microversion: 2.1 time: 0.161555 Aug 01 22:46:26.263366 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 225/420] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:26 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1239 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:26.275052 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:26.278460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:26.317348 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.318510 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.320896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.321906 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.420871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:26.432083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:26.436062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:26.439376 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:26.441521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3853409a-f2f8-4cb4-869c-7561c5a63546 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1722 microversion: 2.20 time: 0.284254 Aug 01 22:46:26.442539 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 196/421] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:26 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:26.453821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4e8b00fe-b5d1-49cf-9361-ddd0aa24e589 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1270 microversion: 2.1 time: 0.179440 Aug 01 22:46:26.453821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 226/422] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:26 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:26.454195 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:26.454195 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:26.470386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.471795 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.474347 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:26.475132 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:26.628288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:26.636913 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-33ec5256-51f6-454f-ac2b-7e5ddec4cc3f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1712 microversion: 2.1 time: 0.192812 Aug 01 22:46:26.637501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 197/423] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:26 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1712 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:27.292033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:27.292657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:27.304543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:27.306531 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:27.307387 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:27.307832 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:27.396980 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:27.405913 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3cdf1d34-feb1-43d7-a803-a08d121fcd5a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1303 microversion: 2.1 time: 0.118992 Aug 01 22:46:27.406798 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 227/424] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:27 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:27.480294 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:27.482485 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:27.483681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:27.484447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:27.504655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:27.505756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:27.512103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:27.515247 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:27.517731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:27.535989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:27.538936 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:27.547138 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:27.717249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:27.732966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a14683cf-ec1e-4838-9922-2152ee3de85a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1276 microversion: 2.1 time: 0.261024 Aug 01 22:46:27.734668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 198/425] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:27 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:27.979424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:28.001926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:28.008974 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:28.018805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e32bc9bf-8fd1-4475-a161-f3428f1306f4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1722 microversion: 2.20 time: 0.539271 Aug 01 22:46:28.019697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 228/426] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:27 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1722 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:28.265061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-4e591c4c-6238-4c26-804a-80d86738a0fa req-a40fff99-04a9-42b1-99a8-3a9ba73da40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d", "name": "network-vif-unplugged", "status": "completed", "tag": "0910ddf7-1491-401d-8e5a-8a12e83a6b3f"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:28.298188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-4e591c4c-6238-4c26-804a-80d86738a0fa req-a40fff99-04a9-42b1-99a8-3a9ba73da40e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:28.302586 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-4e591c4c-6238-4c26-804a-80d86738a0fa req-a40fff99-04a9-42b1-99a8-3a9ba73da40e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:28.338385 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-4e591c4c-6238-4c26-804a-80d86738a0fa req-a40fff99-04a9-42b1-99a8-3a9ba73da40e service nova] Creating event network-vif-unplugged:0910ddf7-1491-401d-8e5a-8a12e83a6b3f for instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d on hv-cinder-85164 Aug 01 22:46:28.355906 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-4e591c4c-6238-4c26-804a-80d86738a0fa req-a40fff99-04a9-42b1-99a8-3a9ba73da40e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098800 Aug 01 22:46:28.358684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 199/427] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:28.437872 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:28.438638 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:28.447371 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:28.448472 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:28.450043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:28.450980 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:28.565248 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:28.586741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4daec303-9b9c-4416-9cb6-2bed41ca1c3a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1301 microversion: 2.1 time: 0.152753 Aug 01 22:46:28.602340 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 229/428] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:28 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:28.763773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:28.764949 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:28.777964 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:28.779053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:28.780728 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:28.781764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:29.052159 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:29.052782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:29.064229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:29.064229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:29.064229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:29.064229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:29.358918 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:29.369991 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:29.377763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:29.382041 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:29.385747 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a55100ac-7805-4bd6-a039-a9d9b0b0d3e5 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1722 microversion: 2.20 time: 0.336424 Aug 01 22:46:29.387635 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 230/429] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:29 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:29.388749 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-efa2ce2c-546e-4075-b3f3-6ed3e3795c5c tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.631486 Aug 01 22:46:29.401597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 200/430] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:28 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:29.624044 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:29.625946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:29.652018 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:29.653167 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:29.654472 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:29.655411 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:30.015580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:30.031198 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cffe59a8-d06d-47f2-a86f-b58a0ff1611b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.413770 Aug 01 22:46:30.032125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 231/431] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:29 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:30.418873 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:30.420728 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:30.432035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:30.433098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:30.433759 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:30.434775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:30.435560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:30.436020 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:30.448777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:30.450334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:30.453442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:30.455976 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:30.690773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:30.716122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1e2611e7-3ea3-4c08-8809-ac1ec92e5109 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.302763 Aug 01 22:46:30.717114 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 201/432] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:30 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:30.746323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:30.764059 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:30.767046 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:30.769738 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a57a3d38-fb5f-43d4-a535-f46216fad6fa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1722 microversion: 2.20 time: 0.347296 Aug 01 22:46:30.782650 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 232/433] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:30 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:31.058165 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:31.059286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:31.067439 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:31.070994 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:31.071601 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:31.072399 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:31.072884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:31.768095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:31.770311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:31.787387 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:31.789186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:31.790799 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:31.792881 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:31.831202 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:31.850329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a1455c79-0f17-4f82-8016-93a82f9215c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.797433 Aug 01 22:46:31.852320 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 202/434] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:31 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:31.863753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:31.865440 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:31.874105 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:31.874842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:31.875816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:31.876446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:32.056802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:32.065867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dddcacb0-7852-4cf6-ad72-499667e8c04b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.307257 Aug 01 22:46:32.067124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 233/435] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:31 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:32.075623 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-197026377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1274276978", "security_groups": [{"name": "tempest-secgroup-smoke-1874346094"}], "networks": [{"uuid": "732c4d6e-275b-4601-960d-0ad3dfd3c35d"}], "block_device_mapping_v2": [{"uuid": "90044346-3d78-43ea-8173-904a56fce298", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:32.236756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] validate_networks() for [('732c4d6e-275b-4601-960d-0ad3dfd3c35d', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:46:32.240681 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:32.254453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:32.257936 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:32.261224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c291e9b5-fb9a-4676-b893-7ef0f9358f5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1665 microversion: 2.20 time: 0.407164 Aug 01 22:46:32.262412 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 203/436] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:31 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1665 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:32.293514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2989cb4d-606e-47a1-8930-ef54d1d7673f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c247d77b-e1d7-4c8c-964c-91a8f1c79906"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:32.299443 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2989cb4d-606e-47a1-8930-ef54d1d7673f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:32.311164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2989cb4d-606e-47a1-8930-ef54d1d7673f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:32.313179 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2989cb4d-606e-47a1-8930-ef54d1d7673f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:32.315674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2989cb4d-606e-47a1-8930-ef54d1d7673f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:32.316351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2989cb4d-606e-47a1-8930-ef54d1d7673f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:32.337678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:32.461776 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:32.490625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:32.689522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:32.914842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2989cb4d-606e-47a1-8930-ef54d1d7673f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.625833 Aug 01 22:46:32.922641 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 204/437] 10.222.0.47 () {62 vars in 1364 bytes} [Mon Aug 1 22:46:32 2022] POST /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments => generated 188 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:46:32.932985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:46:32.933956 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:46:32.934782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:46:32.935346 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:46:32.935915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:46:32.950863 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:32.951551 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:32.952202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:32.953200 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:32.954714 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:32.955660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:32.971379 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=14 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:32.987812 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:32.989208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Getting quotas for project dcf006ee932d483b9cb06f83b7b86b47. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:46:32.991404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:32.997258 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Getting quotas for user bdfea4c2f4f94cec9cabde2c7822b9a9 and project dcf006ee932d483b9cb06f83b7b86b47. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:46:32.999895 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:33.000513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:33.131188 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:46:33.142953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90044346-3d78-43ea-8173-904a56fce298',volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:46:33.440521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ceadd955-e924-4764-b3f5-18dd6725d340 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.371639 Aug 01 22:46:33.442120 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 234/438] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:46:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:46:33.454548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-bd7d6ba6-19a0-4796-9288-04785c16110a req-775580d0-ef8a-4439-b558-9fdc2b411b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40608dc4-7e0c-4f8e-83cc-8f514e3ca783", "tag": "cbe357ac-0ec9-4656-93e3-83c29a2e5708"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:33.468075 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bd7d6ba6-19a0-4796-9288-04785c16110a req-775580d0-ef8a-4439-b558-9fdc2b411b78 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:33.468612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bd7d6ba6-19a0-4796-9288-04785c16110a req-775580d0-ef8a-4439-b558-9fdc2b411b78 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:33.480174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-bd7d6ba6-19a0-4796-9288-04785c16110a req-775580d0-ef8a-4439-b558-9fdc2b411b78 service nova] Creating event network-changed:cbe357ac-0ec9-4656-93e3-83c29a2e5708 for instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 on hv-cinder-85164 Aug 01 22:46:33.485684 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-bd7d6ba6-19a0-4796-9288-04785c16110a req-775580d0-ef8a-4439-b558-9fdc2b411b78 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041568 Aug 01 22:46:33.487631 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 235/439] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:33.494270 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:33.495626 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:33.503252 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:33.504062 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:33.505084 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:33.505632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:33.652576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:33.669967 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-727d866a-d642-4045-9088-a9bf20b5d436 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.745463 Aug 01 22:46:33.686800 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 205/440] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:32 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:33.708018 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:33.709220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:33.712742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:33.722720 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4aaa6deb-b98a-4e62-a625-8da584ac4764 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.232867 Aug 01 22:46:33.723886 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 236/441] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:33 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:33.729153 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:33.729492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a98dca43-3b8a-4380-b424-5b973d249801 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:33.729646 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:33.730404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:33.730696 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a98dca43-3b8a-4380-b424-5b973d249801 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:33.730831 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:33.819370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a98dca43-3b8a-4380-b424-5b973d249801 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:33.827401 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a98dca43-3b8a-4380-b424-5b973d249801 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1088 microversion: 2.1 time: 0.102013 Aug 01 22:46:33.829313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 237/442] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:33 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1088 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:33.860747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124356) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 22:46:34.039308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-18ae411b-eb2c-4bb0-8d8e-af84af79e335 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/action" status: 202 len: 0 microversion: 2.20 time: 0.351037 Aug 01 22:46:34.040072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 206/443] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 1 22:46:33 2022] POST /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:46:34.052628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:34.053257 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:34.064214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:34.064672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:34.068208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:34.068866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:34.298609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:34.302644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:34.320126 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:34.322246 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:34.323647 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-17ad17d0-3727-4f7c-b0b3-e882b51e04f8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1751 microversion: 2.20 time: 0.275424 Aug 01 22:46:34.324678 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 238/444] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:34 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1751 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:34.698181 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:34.699446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:34.713459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:34.714586 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:34.717028 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:34.718089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:34.746392 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:34.747482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:34.763857 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:34.764713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:34.766135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:34.767087 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:35.085325 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:35.096345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-61b92916-bc39-42d9-94b2-c1c36b008f09 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.403015 Aug 01 22:46:35.097199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 207/445] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:34 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:35.106052 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:35.106889 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:35.118956 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:35.120555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:35.121615 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:35.122255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:35.153104 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:35.162882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-853605c5-d0a3-44e9-908b-69210946cb2a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.420321 Aug 01 22:46:35.163593 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 239/446] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:34 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:35.240522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:35.252478 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a585163f-24cf-4980-b77c-56c1db6302d8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1138 microversion: 2.1 time: 0.151119 Aug 01 22:46:35.268503 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 208/447] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:35 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1138 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:35.361785 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:35.362389 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:35.364821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:35.372243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:35.372703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:35.373709 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:35.374298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:35.602490 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-7962d4df-6184-4514-86a4-d9cf825c80c4 req-9fed55d8-df33-4a62-9db9-d534bd473496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a77c28-054e-4295-9a4e-6a5fb7be96ab", "tag": "c76e9443-06c4-4019-9d64-775f03142b86"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:35.626163 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7962d4df-6184-4514-86a4-d9cf825c80c4 req-9fed55d8-df33-4a62-9db9-d534bd473496 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:35.626163 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7962d4df-6184-4514-86a4-d9cf825c80c4 req-9fed55d8-df33-4a62-9db9-d534bd473496 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:35.658136 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-7962d4df-6184-4514-86a4-d9cf825c80c4 req-9fed55d8-df33-4a62-9db9-d534bd473496 service nova] Creating event network-changed:c76e9443-06c4-4019-9d64-775f03142b86 for instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab on hv-cinder-85164 Aug 01 22:46:35.670822 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-7962d4df-6184-4514-86a4-d9cf825c80c4 req-9fed55d8-df33-4a62-9db9-d534bd473496 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079991 Aug 01 22:46:35.671804 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 209/448] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:46:35.701957 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:35.714548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:35.718541 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:35.720498 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d03854f9-4ab7-46a5-807b-0773f5388d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1751 microversion: 2.20 time: 0.362856 Aug 01 22:46:35.722670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 240/449] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:35 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1751 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:36.125686 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:36.126805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:36.135572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.136109 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:36.137337 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.138122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:36.221909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:36.222645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:36.259595 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.260365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:36.272305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.273089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:36.421449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:36.443576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2beb7692-8fdd-454a-abaa-3004954dcdcf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.323510 Aug 01 22:46:36.444698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 210/450] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:36 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:36.451446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:36.452675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:36.464718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.465790 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:36.467626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.468534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:36.587235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:36.683857 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-985e9d6b-1f52-4d82-9f37-5709219b10e8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1138 microversion: 2.1 time: 0.237078 Aug 01 22:46:36.684598 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 211/451] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:36 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1138 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:36.740258 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:36.755210 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a312686b-9e4d-4e1b-8bc9-46867438cc4f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.549343 Aug 01 22:46:36.794438 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 241/452] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:36 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:36.802535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:36.803921 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:36.838816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.839779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:36.840982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:36.842300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:37.210177 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:37.223304 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:37.227549 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:37.246599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7067937f-2973-486b-a36c-2aae240dbb84 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1751 microversion: 2.20 time: 0.454598 Aug 01 22:46:37.248251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 212/453] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:36 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1751 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:37.471554 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:37.472761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:37.485247 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:37.486590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:37.488289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:37.489120 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:37.733405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:37.733405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:37.751666 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:37.752448 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:37.753630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:37.754352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:37.933308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:37.942273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ce233e24-9699-4b94-a45b-877e071eb1aa tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1194 microversion: 2.1 time: 0.214743 Aug 01 22:46:37.970158 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 213/454] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:37 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1194 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:37.970459 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:37.980832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:37.980832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:37.989393 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:37.989968 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:37.990989 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:37.996041 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c3d04a13-2a05-4690-a98c-41e4f481bd99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.532813 Aug 01 22:46:38.003100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 242/455] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:37 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:38.017915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:38.289004 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:38.290213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:38.311020 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:38.313602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:38.319573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:38.320666 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:38.482464 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:38.490879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e5356cb1-d6dc-42ee-9f34-cee085f0a82f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.532854 Aug 01 22:46:38.491468 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 214/456] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:37 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:38.837404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-0a7237fc-32e2-4234-8733-d1c44f49ead6 req-3b8ec2b8-0ae7-4c08-8dc1-614f53e0d887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40608dc4-7e0c-4f8e-83cc-8f514e3ca783", "name": "network-vif-plugged", "status": "completed", "tag": "cbe357ac-0ec9-4656-93e3-83c29a2e5708"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:38.848496 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:38.866501 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:38.870513 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:38.871542 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-0a7237fc-32e2-4234-8733-d1c44f49ead6 req-3b8ec2b8-0ae7-4c08-8dc1-614f53e0d887 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:38.872072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-0a7237fc-32e2-4234-8733-d1c44f49ead6 req-3b8ec2b8-0ae7-4c08-8dc1-614f53e0d887 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:38.874120 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-247ed631-e1c0-4bae-bff9-11248859fd3a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1753 microversion: 2.20 time: 0.592149 Aug 01 22:46:38.877816 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 243/457] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:38 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1753 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:38.888902 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-0a7237fc-32e2-4234-8733-d1c44f49ead6 req-3b8ec2b8-0ae7-4c08-8dc1-614f53e0d887 service nova] Creating event network-vif-plugged:cbe357ac-0ec9-4656-93e3-83c29a2e5708 for instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 on hv-cinder-85164 Aug 01 22:46:38.896837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-0a7237fc-32e2-4234-8733-d1c44f49ead6 req-3b8ec2b8-0ae7-4c08-8dc1-614f53e0d887 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063305 Aug 01 22:46:38.899012 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 215/458] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:38.990085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:38.991143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:39.007570 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:39.008181 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:39.009284 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:39.013009 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:39.023496 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:39.024617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:39.050122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:39.050593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:39.073495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:39.075813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:39.355706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:39.370180 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cf34919a-e190-4d66-8346-b1f867fc0073 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1204 microversion: 2.1 time: 0.384865 Aug 01 22:46:39.377667 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 244/459] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:38 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1204 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:39.518280 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:39.518964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:39.535972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:39.537033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:39.538214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:39.538929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:39.941048 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:39.989521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f447122b-f866-42a5-b8ed-ea3f60d22312 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.475844 Aug 01 22:46:40.021251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 245/460] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:39 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:40.039220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:40.040672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:40.053231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:40.054133 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:40.055753 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:40.056281 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:40.097805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:40.120740 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f97e8037-9bc6-4c4e-903b-22467bd5ebd8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 1.102254 Aug 01 22:46:40.123539 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 216/461] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:39 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:40.378257 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:40.392726 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:40.394241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:40.395592 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cebbaee4-dc4a-4bda-83bf-bca384745659 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.373136 Aug 01 22:46:40.396340 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 246/462] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:40 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:40.412978 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:40.414445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:40.427807 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:40.428627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:40.430511 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:40.431306 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:40.857499 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:40.877635 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7576df6d-b2ed-4dbe-97e8-d57a6dc46493 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.483618 Aug 01 22:46:40.878287 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 217/463] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:40 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:41.029177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:41.029927 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:41.044747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-f0ddd9a3-316d-4619-b9c5-43bca53eeb6b req-1290a8ad-662a-4af1-92bc-32651df78884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a77c28-054e-4295-9a4e-6a5fb7be96ab", "name": "network-vif-plugged", "status": "completed", "tag": "c76e9443-06c4-4019-9d64-775f03142b86"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:41.050631 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.051171 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.052137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.052602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.062317 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f0ddd9a3-316d-4619-b9c5-43bca53eeb6b req-1290a8ad-662a-4af1-92bc-32651df78884 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.063183 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f0ddd9a3-316d-4619-b9c5-43bca53eeb6b req-1290a8ad-662a-4af1-92bc-32651df78884 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.081494 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-f0ddd9a3-316d-4619-b9c5-43bca53eeb6b req-1290a8ad-662a-4af1-92bc-32651df78884 service nova] Creating event network-vif-plugged:c76e9443-06c4-4019-9d64-775f03142b86 for instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab on hv-cinder-85164 Aug 01 22:46:41.087601 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-f0ddd9a3-316d-4619-b9c5-43bca53eeb6b req-1290a8ad-662a-4af1-92bc-32651df78884 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048446 Aug 01 22:46:41.088909 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 218/464] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:41.151620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:41.154175 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:41.165273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.166486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.167708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.168329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.465635 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:41.481886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3c99b7cf-339c-446b-ade4-79780100a5ca tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.338608 Aug 01 22:46:41.483916 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 219/465] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:41 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:41.495519 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:41.497092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:41.536520 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.540764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.545364 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.546688 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.777597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:41.798038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-126db724-9337-47ad-897e-182087137120 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.773122 Aug 01 22:46:41.806329 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 247/466] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:41 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:41.918129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:41.922482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:41.950509 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.953910 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.958126 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:41.960445 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:41.977989 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:41.986631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:42.003083 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:42.006388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:42.010187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-115c8f1b-2096-4105-8a7b-b32d884ddf8f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.522873 Aug 01 22:46:42.012002 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 220/467] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:41 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:42.036843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-c9f7b5b0-bf6d-4b62-b6af-05576d63f48f req-2ac9daa5-7759-4509-9248-3853ad60c28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5b4fd5-f825-4c44-9be7-6e8139ae11b8", "tag": "35b78388-fa60-4721-9b49-2f3ca747180d"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:42.061765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-c9f7b5b0-bf6d-4b62-b6af-05576d63f48f req-2ac9daa5-7759-4509-9248-3853ad60c28e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:42.063593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-c9f7b5b0-bf6d-4b62-b6af-05576d63f48f req-2ac9daa5-7759-4509-9248-3853ad60c28e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:42.102007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-c9f7b5b0-bf6d-4b62-b6af-05576d63f48f req-2ac9daa5-7759-4509-9248-3853ad60c28e service nova] Creating event network-changed:35b78388-fa60-4721-9b49-2f3ca747180d for instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 on hv-cinder-85164 Aug 01 22:46:42.113945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-c9f7b5b0-bf6d-4b62-b6af-05576d63f48f req-2ac9daa5-7759-4509-9248-3853ad60c28e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082207 Aug 01 22:46:42.116540 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 221/468] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:42.275105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:42.283865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b951791b-a974-4e15-9382-6edcc00865bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.379587 Aug 01 22:46:42.284603 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 248/469] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:41 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:42.518295 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:42.520316 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:42.530144 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:42.532113 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:42.532865 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:42.533943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:42.845934 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:42.850597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:42.891753 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:42.894488 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:42.896325 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:42.897702 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:42.976915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:42.996383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:43.029885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-fa62be4a-6524-4430-b3f6-a60905ae71a0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1369 microversion: 2.1 time: 0.516542 Aug 01 22:46:43.030914 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 222/470] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:42 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1369 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:43.054104 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:43.055225 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:43.065320 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:43.066231 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:43.067695 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:43.068518 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:43.209515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:43.219586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1a4eec2e-e19c-4e03-aaeb-2a25fe848a74 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.395710 Aug 01 22:46:43.220781 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 249/471] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:42 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:43.310998 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:43.312191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:43.323083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:43.323548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:43.324343 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:43.324972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:43.377698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:43.388578 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:43.390613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:43.392066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e1e38d45-5743-4afd-8ac0-7b37c27666ca tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.344471 Aug 01 22:46:43.393460 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 223/472] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:43 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:43.708241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:43.743867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-151b9d7b-0d1f-4875-abb4-be4168a3fca0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.436657 Aug 01 22:46:43.762320 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 250/473] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:43 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:44.067296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:44.069166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:44.079600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.080835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.082696 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.083732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.254030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=8 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:44.262149 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:44.264965 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:44.277348 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.278186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.279442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.280118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.368473 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:44.389031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-895241cd-7208-44c4-90c7-5d06b8d60030 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1564 microversion: 2.1 time: 0.332489 Aug 01 22:46:44.391544 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 224/474] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:44 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1564 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:44.436702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-beaea627-06fa-4ef3-8732-619c9ae6ac24 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:44.438671 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-beaea627-06fa-4ef3-8732-619c9ae6ac24 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:44.453335 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beaea627-06fa-4ef3-8732-619c9ae6ac24 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.454846 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beaea627-06fa-4ef3-8732-619c9ae6ac24 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.457430 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beaea627-06fa-4ef3-8732-619c9ae6ac24 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.459064 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beaea627-06fa-4ef3-8732-619c9ae6ac24 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.577829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:44.593379 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b13760d9-4ced-4166-bcfa-51ad5ee5e2d9 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.340068 Aug 01 22:46:44.594777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 251/475] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:44 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:44.603425 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:44.604937 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:44.617700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.620078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.622204 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.623108 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.675112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-beaea627-06fa-4ef3-8732-619c9ae6ac24 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.254104 Aug 01 22:46:44.675904 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 225/476] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:46:44 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:44.780756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:44.781974 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:44.808898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.809423 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:44.810270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:44.810942 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:45.111661 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:45.120256 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-497d4cfb-969d-46a9-bc8e-c75d85704c4c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.347154 Aug 01 22:46:45.120873 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 226/477] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:44 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:45.179741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:45.192234 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:45.193813 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:45.195142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b6bdba25-7bbb-4c8c-8cc8-f116c7365e0a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.598568 Aug 01 22:46:45.195717 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 252/478] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:44 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:45.752107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:45.754089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:45.775079 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:45.783242 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:45.788627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:45.793076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:46.157451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:46.159454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:46.180790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:46.181670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:46.182752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:46.183367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:46.258856 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:46.288777 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-adb42b56-7ed9-400b-932c-6740d5867dcb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1318 microversion: 2.1 time: 0.675593 Aug 01 22:46:46.289845 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 227/479] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:45 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:46.297987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:46.306328 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:46.320943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:46.321789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:46.322533 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:46.323047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:46.541973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:46.561793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:46.563491 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:46.564720 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-edaeb8fe-fca8-4ed4-8f23-579c0e32a5ee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.270597 Aug 01 22:46:46.565305 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 228/480] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:46 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:47.070780 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:47.081589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2bb6687b-ffba-4f95-955d-f74df4e2d6da tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.929284 Aug 01 22:46:47.082681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 253/481] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:46 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:47.357164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:47.358538 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:47.366729 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:47.367506 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:47.368572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:47.369898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:47.616181 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:47.617143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:47.639795 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:47.640687 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:47.656731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:47.657279 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:47.715413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:47.730754 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e1f3a87b-4969-4f9a-b668-e5f61d4e3fb1 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1507 microversion: 2.1 time: 0.384780 Aug 01 22:46:47.762795 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 229/482] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:47 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:48.121016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:48.121951 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:48.141368 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:48.143132 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:48.146769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:48.150421 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:48.215296 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:48.229728 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:48.242654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:48.244768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9b7ab525-c746-4678-a750-4daea00f2524 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.636798 Aug 01 22:46:48.246089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 254/483] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:47 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:48.251151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-0a10fe5b-681b-44e5-96c0-98286066daf7 req-6b6e978e-6a23-4d13-8446-6a349fe3787e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40608dc4-7e0c-4f8e-83cc-8f514e3ca783", "tag": "cbe357ac-0ec9-4656-93e3-83c29a2e5708"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:46:48.275384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-0a10fe5b-681b-44e5-96c0-98286066daf7 req-6b6e978e-6a23-4d13-8446-6a349fe3787e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:48.278663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-0a10fe5b-681b-44e5-96c0-98286066daf7 req-6b6e978e-6a23-4d13-8446-6a349fe3787e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:48.311652 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-0a10fe5b-681b-44e5-96c0-98286066daf7 req-6b6e978e-6a23-4d13-8446-6a349fe3787e service nova] Creating event network-changed:cbe357ac-0ec9-4656-93e3-83c29a2e5708 for instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 on hv-cinder-85164 Aug 01 22:46:48.321307 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-0a10fe5b-681b-44e5-96c0-98286066daf7 req-6b6e978e-6a23-4d13-8446-6a349fe3787e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072597 Aug 01 22:46:48.321307 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 255/484] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:46:48.555173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:48.601402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-cd456bb3-8269-4d7e-a752-7073195ddcd6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.484349 Aug 01 22:46:48.626710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 230/485] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:48 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:49.280072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:49.282182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:49.303026 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:49.304146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:49.306740 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:49.307459 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:49.318140 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:49.591052 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:49.612426 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:49.614598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:49.616957 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c031f07a-278f-449d-9e11-bce48aa5dfb8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.345157 Aug 01 22:46:49.636143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 256/486] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:49 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:49.643260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:49.644055 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:49.650950 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:49.651389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:49.652161 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:49.652590 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:49.911207 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:49.921843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-66723ba8-5ec8-44ce-9b59-67406ab3ab3d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.284037 Aug 01 22:46:49.941271 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 231/487] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:49 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:50.651762 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:50.655705 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:50.676476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:50.678536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:50.680823 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:50.682101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:50.951303 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:50.952101 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:50.973823 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:50.975164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:50.978000 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:50.981859 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:51.029029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:51.053432 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:51.057053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:51.058610 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f006a915-4996-4bd4-bf7e-07a933929cb0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.413875 Aug 01 22:46:51.059638 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 257/488] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:50 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:51.614761 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:51.630924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8ff179f6-e6ff-4868-85a9-a5d6acbb3991 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.685750 Aug 01 22:46:51.632087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 232/489] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:50 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:46:52.104061 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:52.117633 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:52.128957 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:52.130036 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:52.131663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:52.132586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:52.553817 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:52.564155 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:52.566318 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:52.568597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8f195d3d-6e5c-4b9f-9d32-5a96fc55a586 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.479189 Aug 01 22:46:52.569244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 258/490] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:52 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:52.656386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:52.657519 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:52.667352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:52.668062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:52.669756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:52.670752 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:52.930692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:52.944679 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c85ac7da-2ec2-424a-b985-225cb2640a2e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.293473 Aug 01 22:46:52.946120 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 233/491] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:52 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:53.623621 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:53.624488 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:53.633314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:53.633823 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:53.634602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:53.635029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:53.847185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:53.869763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:53.872757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:53.875345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0a074c0c-0ec6-41ba-8bd5-1e6b10355f89 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.255624 Aug 01 22:46:53.876300 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 259/492] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:53 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:53.967560 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:53.968318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:53.976555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:53.977638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:53.979107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:53.979953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:54.270012 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:54.281798 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a62a3dd5-f35d-4320-b46d-bc26395f536f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.318644 Aug 01 22:46:54.282780 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 234/493] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:53 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:54.916889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:54.918152 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:54.929281 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:54.930071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:54.931412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:54.932148 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:55.159279 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:55.174632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:55.177250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:55.179724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-13716a16-0c5f-4f90-8908-43ed64064695 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.269975 Aug 01 22:46:55.184326 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 260/494] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:54 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:55.311673 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:55.320124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:55.329122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:55.329826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:55.330814 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:55.331572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:55.568038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:55.579614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bd30ce5e-4bd1-4ec7-bf30-a287d8f3cf6c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.275070 Aug 01 22:46:55.598907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 235/495] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:55 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:56.208465 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:56.209083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:56.216006 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:56.216450 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:56.217600 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:56.218033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:56.455099 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:56.470045 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:56.471531 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:56.472858 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b7a5e8a3-cbad-4854-8b6a-02588079e093 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.268428 Aug 01 22:46:56.473415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 261/496] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:56 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:56.621349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:56.622622 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:56.634437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:56.635357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:56.636822 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:56.637621 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:56.862525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:56.877730 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a3db4a62-8152-4682-8727-a166594d5254 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.264117 Aug 01 22:46:56.878638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 236/497] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:56 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:57.505405 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:57.506109 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:57.513708 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:57.514356 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:57.515773 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:57.516616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:57.710090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:57.725972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:57.728809 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:57.730905 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0e04c5bd-44e7-4c75-afc7-abe9dff6e275 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.229300 Aug 01 22:46:57.741627 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 262/498] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:57 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:46:57.906714 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:57.907649 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:57.926521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:57.927588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:57.929200 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:57.930229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:58.176652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:58.208706 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-553f3510-d022-4c5d-8ab9-3f9d753f4881 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.297585 Aug 01 22:46:58.215485 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 237/499] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:57 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:46:58.768655 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:58.769797 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:58.781812 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:58.782593 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:58.783956 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:58.784732 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:59.006120 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:59.022865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:59.025310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:59.034242 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1d011278-4ed8-419d-98a5-c52948100233 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.273256 Aug 01 22:46:59.034948 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 263/500] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:46:58 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:46:59.250176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:46:59.252133 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:46:59.262765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:59.263616 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:59.265043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:46:59.265918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:46:59.302294 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:46:59.453515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:46:59.468296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-aa55f30f-a0b2-4f3e-be6a-373cc14d5ec2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.222741 Aug 01 22:46:59.469862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 238/501] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:46:59 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:00.060779 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:00.061720 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:00.073293 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:00.073952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:00.075002 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:00.075708 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:00.278888 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:00.290615 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:00.292939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:00.294342 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d480c68f-9998-49bf-aa5d-839c520bedbd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.239480 Aug 01 22:47:00.295145 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 264/502] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:00 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:47:00.497684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:00.498306 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:00.505110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:00.505651 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:00.506640 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:00.507246 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:00.700560 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:00.711058 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-601ee5c9-1c55-4d36-83b7-1bb311caa49a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.218185 Aug 01 22:47:00.711923 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 239/503] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:00 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:01.324885 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:01.326064 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:01.339760 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:01.340194 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:01.341012 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:01.341475 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:01.600554 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:01.619469 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:01.622550 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:01.625018 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d04a12fc-0393-4a38-a51c-3bd504cc6d35 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.305597 Aug 01 22:47:01.626182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 265/504] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:01 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:01.745384 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:01.746450 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:01.751566 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:01.759137 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:01.760292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:01.762028 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:01.762776 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:02.298012 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:02.310922 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f6457059-cc08-4300-8e42-6e07283094f7 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.572314 Aug 01 22:47:02.311759 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 240/505] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:01 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:02.657038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:02.658305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:02.667471 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:02.667972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:02.669033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:02.669503 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:02.874837 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:02.889804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:02.892587 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:02.894789 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2015808b-840e-4cd9-b436-845a791b550a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.244538 Aug 01 22:47:02.895770 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 266/506] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:02 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:03.336485 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:03.337520 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:03.350336 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:03.351103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:03.352388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:03.352985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:03.564643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:03.579846 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f57a4377-a977-4404-a732-919eca5e81e1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.247492 Aug 01 22:47:03.580756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 241/507] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:03 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:47:03.937201 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:03.938383 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:03.950020 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:03.950771 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:03.952117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:03.952843 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:04.124713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:04.135244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:04.136942 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:04.138320 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-db85e7f9-97cb-4658-a6d5-6dbaab7a76e8 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.208908 Aug 01 22:47:04.139073 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 267/508] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:03 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:04.615226 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:04.615849 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:04.622516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:04.623102 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:04.624384 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:04.625133 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:04.830970 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:04.843241 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ef51c3c0-6d34-48ef-b39f-f9de31498a01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.231839 Aug 01 22:47:04.843851 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 242/509] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:04 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:05.166246 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:05.167172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:05.175511 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:05.176007 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:05.176984 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:05.177455 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:05.370337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:05.384916 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:05.387506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:05.389071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3ba87260-4b71-4ef2-8a05-004a87b8873a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.229152 Aug 01 22:47:05.389721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 268/510] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:05 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:05.876006 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:05.877087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:05.887318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:05.888095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:05.889405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:05.890206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:06.080935 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:06.089711 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7a3d1332-4aa0-4435-b858-e1ce8c2a7a7a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.220952 Aug 01 22:47:06.090491 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 243/511] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:05 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:47:06.416539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:06.417302 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:06.421080 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=58 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:06.425344 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:06.426124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:06.426598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:06.427030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:06.629177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:06.645959 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:06.648817 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:06.650938 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-23eb974b-eb33-4705-ae76-c00f85ff3e41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.238899 Aug 01 22:47:06.651904 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 269/512] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:06 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:07.125635 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:07.126970 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:07.143644 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:07.144995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:07.147319 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:07.148514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:07.342648 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:07.353195 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e6836f55-a9c6-44b9-ba1f-4e60bca5647f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.235572 Aug 01 22:47:07.354107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 244/513] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:07 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:07.695303 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:07.696494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:07.717740 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:07.718625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:07.719822 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:07.720684 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:07.900362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:07.909343 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:07.911994 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:07.917608 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-57254455-8ad2-4492-9baf-63f57f6c9e37 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.229391 Aug 01 22:47:07.917608 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 270/514] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:07 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:47:08.382489 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:08.383570 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:08.392059 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:08.392562 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:08.393410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:08.393931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:08.547308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:08.562309 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-77db833a-ed2a-4fc2-82b6-299824a28a84 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.185676 Aug 01 22:47:08.563344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 245/515] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:08 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:08.946804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:08.947942 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:08.961396 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:08.962161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:08.963681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:08.964528 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:09.054675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-864f223f-fc6a-47a3-a737-bcab19e676d9 req-39862218-bc70-448d-b1cb-5648a1c15bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5b4fd5-f825-4c44-9be7-6e8139ae11b8", "name": "network-vif-plugged", "status": "completed", "tag": "35b78388-fa60-4721-9b49-2f3ca747180d"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:09.074100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-864f223f-fc6a-47a3-a737-bcab19e676d9 req-39862218-bc70-448d-b1cb-5648a1c15bc6 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:09.074779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-864f223f-fc6a-47a3-a737-bcab19e676d9 req-39862218-bc70-448d-b1cb-5648a1c15bc6 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:09.099753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-864f223f-fc6a-47a3-a737-bcab19e676d9 req-39862218-bc70-448d-b1cb-5648a1c15bc6 service nova] Creating event network-vif-plugged:35b78388-fa60-4721-9b49-2f3ca747180d for instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 on hv-cinder-85164 Aug 01 22:47:09.108442 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-864f223f-fc6a-47a3-a737-bcab19e676d9 req-39862218-bc70-448d-b1cb-5648a1c15bc6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061851 Aug 01 22:47:09.109868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 246/516] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:47:09.175171 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:09.189955 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:09.191924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:09.194462 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-03af9e23-8110-4d52-afee-67ff6d7bede1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.254465 Aug 01 22:47:09.195803 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 271/517] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:08 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:09.599427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:09.600437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:09.612504 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:09.613410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:09.614924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:09.615709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:09.820611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:09.830427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-feffdbce-7968-4828-902f-d72b6f4ee14a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.238085 Aug 01 22:47:09.831034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 247/518] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:09 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:10.235826 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:10.236591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:10.243790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:10.244214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:10.244989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:10.245430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:10.444477 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:10.448112 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:10.462598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:10.465504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:10.468095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b90c70de-c441-433b-b1e4-d44cbce8fede tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.238637 Aug 01 22:47:10.469121 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 272/519] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:10 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:47:10.857247 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:10.858112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:10.866772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:10.867400 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:10.868404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:10.869107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:11.121123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:11.136134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4dca5370-0bc2-4bc7-b64e-88a95ef27de6 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1260 microversion: 2.1 time: 0.286155 Aug 01 22:47:11.137441 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 248/520] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:10 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:11.501344 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:11.502513 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:11.514249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:11.515032 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:11.516403 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:11.517310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:11.715882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:11.726613 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:11.728492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:11.729895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bcd678e1-28c4-40c2-9e18-3e230ca447d9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.235961 Aug 01 22:47:11.730603 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 273/521] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:11 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:12.171663 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:12.172685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:12.183809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:12.184580 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:12.186018 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:12.186793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:12.473983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:12.485996 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-97379bc5-a705-4891-9593-26546913ea99 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1445 microversion: 2.1 time: 0.320517 Aug 01 22:47:12.487764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 249/522] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:12 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1445 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:12.524628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:12.525480 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:12.532804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:12.533232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:12.534091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:12.534543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:12.734621 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:12.746115 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-06af8d93-feda-4c4d-97b3-46210e8f2456 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1445 microversion: 2.1 time: 0.230849 Aug 01 22:47:12.746855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 274/523] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:12 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1445 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:12.755604 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:12.756388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:12.764179 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:12.764627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:12.765414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:12.765882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:12.993332 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:13.009464 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:13.011990 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:13.013502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-56e0bd01-a9a3-4e56-a23e-2e9fea17cd12 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.263049 Aug 01 22:47:13.014121 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 250/524] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:12 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:13.179079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-899b8877-29fe-410a-8c11-89ab8d49fec9 req-da27d0c7-2bf7-404d-a5c0-2f5b4970a528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d", "name": "network-vif-plugged", "status": "completed", "tag": "0910ddf7-1491-401d-8e5a-8a12e83a6b3f"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:13.202249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-899b8877-29fe-410a-8c11-89ab8d49fec9 req-da27d0c7-2bf7-404d-a5c0-2f5b4970a528 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:13.202684 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-899b8877-29fe-410a-8c11-89ab8d49fec9 req-da27d0c7-2bf7-404d-a5c0-2f5b4970a528 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:13.240654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-899b8877-29fe-410a-8c11-89ab8d49fec9 req-da27d0c7-2bf7-404d-a5c0-2f5b4970a528 service nova] Creating event network-vif-plugged:0910ddf7-1491-401d-8e5a-8a12e83a6b3f for instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d on hv-cinder-85164 Aug 01 22:47:13.251006 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-899b8877-29fe-410a-8c11-89ab8d49fec9 req-da27d0c7-2bf7-404d-a5c0-2f5b4970a528 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074736 Aug 01 22:47:13.252653 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 275/525] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:47:14.066782 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:14.067560 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:14.077674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:14.078852 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:14.080228 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:14.081073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:14.417707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:14.432800 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:14.435230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:14.437016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8ea268f0-c9c3-4ed1-88cb-35c1271ee31b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.375854 Aug 01 22:47:14.438243 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 251/526] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:14 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:15.486694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:15.488914 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:15.502551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:15.503989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:15.505355 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:15.506108 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:15.711402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-1212e013-9d31-4330-807b-ef5b9efe800f req-b8db1ffe-0e1e-4b8d-9d7f-64dabec55eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5b4fd5-f825-4c44-9be7-6e8139ae11b8", "tag": "35b78388-fa60-4721-9b49-2f3ca747180d"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:15.730593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-1212e013-9d31-4330-807b-ef5b9efe800f req-b8db1ffe-0e1e-4b8d-9d7f-64dabec55eba service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:15.731905 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-1212e013-9d31-4330-807b-ef5b9efe800f req-b8db1ffe-0e1e-4b8d-9d7f-64dabec55eba service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:15.753890 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-1212e013-9d31-4330-807b-ef5b9efe800f req-b8db1ffe-0e1e-4b8d-9d7f-64dabec55eba service nova] Creating event network-changed:35b78388-fa60-4721-9b49-2f3ca747180d for instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 on hv-cinder-85164 Aug 01 22:47:15.758469 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:15.769016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-1212e013-9d31-4330-807b-ef5b9efe800f req-b8db1ffe-0e1e-4b8d-9d7f-64dabec55eba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063631 Aug 01 22:47:15.770130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 252/527] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:47:15.772829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:15.775901 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:15.777224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c2724835-a7ff-4485-8680-111dddff80b9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.308620 Aug 01 22:47:15.778291 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 276/528] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:15 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:16.547115 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4c33c185-3844-4ffd-be83-7ba7b1424be7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6fad4dd-1c12-459f-9aef-d275e9c39616", "device": "/dev/sdb"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:16.551408 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4c33c185-3844-4ffd-be83-7ba7b1424be7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:16.560106 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4c33c185-3844-4ffd-be83-7ba7b1424be7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:16.560797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4c33c185-3844-4ffd-be83-7ba7b1424be7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:16.562874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4c33c185-3844-4ffd-be83-7ba7b1424be7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:16.563579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4c33c185-3844-4ffd-be83-7ba7b1424be7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:16.804035 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:16.804952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:16.811969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:16.812392 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:16.813164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:16.813612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:17.046221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:17.063924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:17.067253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:17.069018 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e23ae6bf-907e-432c-88fe-72d9e3405eec tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1809 microversion: 2.20 time: 0.271629 Aug 01 22:47:17.073639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 277/529] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:16 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:47:17.580029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4c33c185-3844-4ffd-be83-7ba7b1424be7 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "POST /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.040286 Aug 01 22:47:17.580591 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 253/530] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:47:16 2022] POST /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab/os-volume_attachments => generated 194 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:47:18.104906 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:18.105921 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:18.118236 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:18.118933 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:18.120327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:18.121097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:18.330069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:18.345925 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:18.348683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:18.350823 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8664cef6-6874-41ad-9627-e77c2900b27a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1796 microversion: 2.20 time: 0.253235 Aug 01 22:47:18.352543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 278/531] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:47:18 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1796 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:47:26.527180 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:26.528116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:26.536195 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:26.536692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:26.537515 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:26.538033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:26.698411 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lazy-loading 'services' on Instance uuid 909f43f2-82b3-496f-8561-f7e7e385a275 {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:47:26.733465 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:26.821590 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6103793d-5121-43d3-8dc9-23c35d0032bf tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-volume_attachments/9c2859b8-da14-490a-bcc6-4c6bbf9fa2b0" status: 202 len: 0 microversion: 2.1 time: 0.299566 Aug 01 22:47:26.822240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 254/532] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:47:26 2022] DELETE /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-volume_attachments/9c2859b8-da14-490a-bcc6-4c6bbf9fa2b0 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 22:47:30.154372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8919e30a-446f-484c-8f48-f4f3ff6e535b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:30.158978 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=19 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:30.159941 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=33 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:30.170850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8919e30a-446f-484c-8f48-f4f3ff6e535b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:30.171573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8919e30a-446f-484c-8f48-f4f3ff6e535b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:30.204821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8919e30a-446f-484c-8f48-f4f3ff6e535b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Going to try to stop instance {{(pid=124358) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 22:47:30.267262 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8919e30a-446f-484c-8f48-f4f3ff6e535b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action" status: 202 len: 0 microversion: 2.1 time: 0.119786 Aug 01 22:47:30.268192 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 279/533] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:47:30 2022] POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:47:30.283120 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:30.285431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:30.303943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:30.304647 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:30.306033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:30.306787 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:30.505868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:30.519749 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-243e8367-8635-4b82-8146-1791c77c75bc tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.243768 Aug 01 22:47:30.520758 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 255/534] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:30 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:31.553435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:31.554174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:31.560878 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:31.561276 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:31.562087 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:31.562515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:31.708699 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:31.716659 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c943f3af-2f27-4354-8a2c-931fc0422fd5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.167930 Aug 01 22:47:31.717657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 280/535] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:31 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:32.738707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:32.739606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:32.741836 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=32 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:32.747684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:32.748203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:32.749043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:32.749511 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:33.142757 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:33.150605 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8fb502e5-a3bb-4558-a90c-f5c762730546 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.416072 Aug 01 22:47:33.151176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 256/536] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:32 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:34.174897 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:34.176019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:34.186388 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:34.187134 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:34.188595 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:34.189135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:34.374408 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:34.385863 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-db944e51-dc60-4f35-97d6-fa6065da7337 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.217051 Aug 01 22:47:34.386569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 281/537] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:34 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:47:35.411356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:35.412429 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:35.423090 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:35.423755 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:35.424933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:35.425611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:35.602595 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:35.613748 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c5e251f4-5f07-4aee-8eb7-38b5bb49d711 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.208894 Aug 01 22:47:35.614342 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 257/538] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:35 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:36.636011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:36.636915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:36.644063 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:36.644516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:36.645315 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:36.645789 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:36.803257 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:36.815076 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b8a005d1-4394-4a81-aea3-c97a1d440e74 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.183298 Aug 01 22:47:36.815712 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 282/539] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:36 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:37.840403 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:37.841019 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:37.849131 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:37.849629 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:37.850713 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:37.851165 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:38.014668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:38.023428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e97db250-ec5b-4632-9350-2294881e6c68 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.187618 Aug 01 22:47:38.024143 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 258/540] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:37 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:39.048296 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:39.049336 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:39.060253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:39.060983 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:39.062217 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:39.062867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:39.232243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:39.240427 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1eb2e5f3-1b5a-445c-bed8-8a98b1455c3d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.199128 Aug 01 22:47:39.241012 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 283/541] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:39 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:40.266369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:40.267558 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:40.278544 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:40.278843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:40.279615 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:40.280043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:40.441468 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:40.450140 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6da42211-478f-4c47-ab07-9dc925b04381 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.191168 Aug 01 22:47:40.450722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 259/542] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:40 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:41.472836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:41.473502 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:41.480716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:41.481186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:41.482056 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:41.482512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:41.650366 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:41.658646 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ef8a53a3-f647-4b90-8774-be34cd966932 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.189925 Aug 01 22:47:41.659238 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 284/543] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:41 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:47:41.979796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:41.980556 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:41.987873 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:41.988298 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:41.989060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:41.989681 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:42.102219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lazy-loading 'services' on Instance uuid 48a77c28-054e-4295-9a4e-6a5fb7be96ab {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:47:42.196561 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f0f90c78-9aae-4a93-9510-cdaa7f06fc18 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "DELETE /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab/os-volume_attachments/b6fad4dd-1c12-459f-9aef-d275e9c39616" status: 202 len: 0 microversion: 2.1 time: 0.223454 Aug 01 22:47:42.197445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 260/544] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:47:41 2022] DELETE /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab/os-volume_attachments/b6fad4dd-1c12-459f-9aef-d275e9c39616 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:47:42.686957 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:42.687547 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:42.695372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:42.695960 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:42.696873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:42.697349 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:42.872876 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:42.880591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0d05f94a-32d3-43b2-98c0-b8fdd14eac1e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.199496 Aug 01 22:47:42.881176 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 285/545] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:42 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:43.365597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:43.366262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:43.373870 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:43.374398 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:43.375241 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:43.375678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:43.407951 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Going to try to terminate instance {{(pid=124356) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:47:43.502480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c2efd880-974b-4b35-bf97-294655568d62 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "DELETE /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 204 len: 0 microversion: 2.1 time: 0.140972 Aug 01 22:47:43.503230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 261/546] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:47:43 2022] DELETE /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:47:43.513094 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:43.513834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:43.520708 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:43.521417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:43.522568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:43.523009 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:43.688449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:43.700937 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d4c35783-2bf9-431c-919d-14fc69bb6255 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1513 microversion: 2.1 time: 0.191437 Aug 01 22:47:43.701946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 286/547] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:43 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:47:43.906363 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:43.907466 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:43.917074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:43.917787 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:43.918712 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:43.919230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:44.084744 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:44.098219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-42dd79e8-3318-4847-9546-c5b69853145a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.198646 Aug 01 22:47:44.099223 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 262/548] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:43 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:44.724748 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:44.725488 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:44.733300 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:44.733802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:44.734659 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:44.735093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:44.926347 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:44.938986 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0dd2d8df-fe2c-4f0b-bd51-6aaac11628ce tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1513 microversion: 2.1 time: 0.217779 Aug 01 22:47:44.939625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 287/549] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:44 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:45.126584 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:45.127199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:45.138783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:45.139513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:45.140745 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:45.141407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:45.309341 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:45.317893 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-196334b1-fa12-42c6-a266-ee7b06c2c6ef tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.196525 Aug 01 22:47:45.318548 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 263/550] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:45 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:45.963040 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:45.963675 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:45.972168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:45.972724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:45.973627 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:45.974290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:46.150098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-f87bcd42-0eeb-472e-9369-86bc448a559d req-fededcde-fac3-4307-bd08-7e47763365b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a77c28-054e-4295-9a4e-6a5fb7be96ab", "name": "network-vif-deleted", "tag": "c76e9443-06c4-4019-9d64-775f03142b86"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:46.160685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f87bcd42-0eeb-472e-9369-86bc448a559d req-fededcde-fac3-4307-bd08-7e47763365b8 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:46.161373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f87bcd42-0eeb-472e-9369-86bc448a559d req-fededcde-fac3-4307-bd08-7e47763365b8 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:46.165142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:46.174852 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-f87bcd42-0eeb-472e-9369-86bc448a559d req-fededcde-fac3-4307-bd08-7e47763365b8 service nova] Creating event network-vif-deleted:c76e9443-06c4-4019-9d64-775f03142b86 for instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab on hv-cinder-85164 Aug 01 22:47:46.180906 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-f87bcd42-0eeb-472e-9369-86bc448a559d req-fededcde-fac3-4307-bd08-7e47763365b8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034520 Aug 01 22:47:46.181669 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 264/551] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:47:46.183739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1f1c3033-ece5-4619-94a2-d9ab763331e4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 200 len: 1513 microversion: 2.1 time: 0.225312 Aug 01 22:47:46.185082 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 288/552] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:45 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:46.344046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:46.344843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:46.352882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:46.353723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:46.354501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:46.354930 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:46.502015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:46.513460 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-174d2053-5f18-4739-8f6d-007285d71083 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.176058 Aug 01 22:47:46.514091 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 265/553] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:46 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:47.214208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:47.215071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: 48a77c28-054e-4295-9a4e-6a5fb7be96ab] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:47.222416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:47.222865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:47.223675 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:47.224098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:47.238474 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] HTTP exception thrown: Instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab could not be found. Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Request method failure captured: Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab HTTP/1.1 Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6Fe5lDkpeH0XTf79mati26eFEVOAYdJPYqyHhHhKWqsVHJKSx4TJoaMJ2NqQ2L2q0abEcshoAtd19YXx48HpUPszIQJOBVPEsH-LBLG_GttddNIy5PnAnpoOtMjumfG1tzjdYqan-Ru2YmEJfwGqx_egVSmKCTY5hcydefln22pAs1g Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 3b04d30f1426408ba5c8fa0238982089 Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesSnapshotTestJSON-873965519 Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:47:47.240146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b04d30f1426408ba5c8fa0238982089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b04d30f1426408ba5c8fa0238982089", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b04d30f1426408ba5c8fa0238982089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b04d30f1426408ba5c8fa0238982089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesSnapshotTestJSON-873965519 Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 3b04d30f1426408ba5c8fa0238982089 Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-873965519 Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesSnapshotTestJSON-873965519-project Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: c362f3a63b944fbcbea080d55c8fdfa1 Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesSnapshotTestJSON-873965519-project Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab could not be found. Aug 01 22:47:47.242710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '48a77c28-054e-4295-9a4e-6a5fb7be96ab'} Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab could not be found. Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:47:47.244100 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab could not be found. Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab could not be found. Aug 01 22:47:47.246287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:47:47.248226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Returning 404 to user: Instance 48a77c28-054e-4295-9a4e-6a5fb7be96ab could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:47:47.248226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f80835f1-63b5-4670-a65d-afe0042bba92 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab" status: 404 len: 111 microversion: 2.1 time: 0.031566 Aug 01 22:47:47.248226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 289/554] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:47 2022] GET /compute/v2.1/servers/48a77c28-054e-4295-9a4e-6a5fb7be96ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:47:47.535418 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:47.536296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:47.543189 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:47.543630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:47.544377 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:47.544853 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:47.689380 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:47.701302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a85c5405-000a-4f2b-8df0-ed04981e9fe4 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.170213 Aug 01 22:47:47.701945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 266/555] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:47 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:48.725288 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:48.725962 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:48.733219 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:48.733696 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:48.734482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:48.734913 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:48.877172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:48.885401 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c5297e9f-b645-4790-8e17-763f286f1bc7 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.164078 Aug 01 22:47:48.886019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 290/556] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:48 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:49.906848 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:49.907486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:49.914873 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:49.915315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:49.916084 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:49.916509 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:50.073052 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:50.080916 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7ee2afaf-9273-4153-9a75-1ab51bdc66e2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1676 microversion: 2.1 time: 0.177876 Aug 01 22:47:50.081827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 267/557] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:49 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:51.103711 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:51.104507 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:51.112298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:51.113455 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:51.113455 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:51.113903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:51.263296 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:51.274126 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a7fa77a-e8ef-46a1-ae17-f34b54b2e495 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1653 microversion: 2.1 time: 0.174649 Aug 01 22:47:51.274746 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 291/558] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:51 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1653 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:51.296738 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-50a5b11c-5354-4cc3-8351-0c5b4d22017b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:51.304286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-50a5b11c-5354-4cc3-8351-0c5b4d22017b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:51.304759 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-50a5b11c-5354-4cc3-8351-0c5b4d22017b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:51.370840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-50a5b11c-5354-4cc3-8351-0c5b4d22017b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Going to try to start instance {{(pid=124356) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 22:47:51.396348 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:51.420571 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-50a5b11c-5354-4cc3-8351-0c5b4d22017b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action" status: 202 len: 0 microversion: 2.1 time: 0.128303 Aug 01 22:47:51.421208 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 268/559] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:47:51 2022] POST /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:47:51.431877 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:51.432572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:51.439155 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:51.439694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:51.440536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:51.441032 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:51.608555 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:51.618402 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9a1c5621-98b3-4c9c-a7dc-4ed4d13f6f32 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1662 microversion: 2.1 time: 0.190689 Aug 01 22:47:51.619032 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 292/560] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:51 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1662 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:47:52.650769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:52.651522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:52.662254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:52.662813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:52.663953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:52.664830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:52.823424 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:52.832611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-88e18d5c-185e-4609-b1d2-92f81580bc15 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1662 microversion: 2.1 time: 0.188337 Aug 01 22:47:52.833270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 269/561] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:52 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1662 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:53.855511 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:53.856494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:53.863290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:53.863732 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:53.864512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:53.864943 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:54.004390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:54.012541 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f4571f87-bbf0-4151-9da3-e62508879254 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1662 microversion: 2.1 time: 0.160877 Aug 01 22:47:54.013452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 293/562] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:53 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:55.036476 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:55.037280 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:55.044632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:55.045189 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:55.046141 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:55.046602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:55.223745 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:55.235360 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-032d2adf-5d60-496a-8f82-238aa8a3ed00 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1662 microversion: 2.1 time: 0.204610 Aug 01 22:47:55.245660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 270/563] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:55 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1662 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:55.349231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-903716928", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "networks": [{"uuid": "8e01b47c-dc86-4c4c-ade8-c4465ce4dc0c"}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:55.417447 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] validate_networks() for [('8e01b47c-dc86-4c4c-ade8-c4465ce4dc0c', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:47:55.883872 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:47:55.884302 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:47:55.884765 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:47:55.885185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:47:55.885611 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:47:55.895588 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:55.896034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:55.896841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:55.897273 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:55.915991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Getting quotas for project 3b04d30f1426408ba5c8fa0238982089. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:47:55.920287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Getting quotas for user c362f3a63b944fbcbea080d55c8fdfa1 and project 3b04d30f1426408ba5c8fa0238982089. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:47:55.935250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:47:55.937531 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:47:55.991141 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-047e9542-1a2d-4320-82bd-3c290bd6dcf6 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648590 Aug 01 22:47:55.991877 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 294/564] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:47:56.016030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ddbb4d6c-6526-4863-b384-bc9e237b9b70 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:56.017796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ddbb4d6c-6526-4863-b384-bc9e237b9b70 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:56.089936 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ddbb4d6c-6526-4863-b384-bc9e237b9b70 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:56.098251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ddbb4d6c-6526-4863-b384-bc9e237b9b70 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1218 microversion: 2.1 time: 0.094754 Aug 01 22:47:56.098843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 271/565] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:55 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:56.259333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:56.260135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:56.268651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:56.269177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:56.270266 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:56.270931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:56.483635 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:56.495510 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:47:56.502893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b8313fc9-71ed-47fc-a9be-c886b5d8135c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1666 microversion: 2.1 time: 0.248662 Aug 01 22:47:56.504826 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 295/566] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:56 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1666 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:57.120292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:57.121206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:57.131447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:57.132148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:57.133379 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:57.135848 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:57.270155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:57.278490 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-315bc35a-552a-4db6-8c50-35dcfd7bbb43 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1270 microversion: 2.1 time: 0.162288 Aug 01 22:47:57.287328 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 272/567] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:57 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:57.903489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-efabac62-9ba4-4aef-b5d7-7fe6dadf1479 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdbbf76b-2a39-4dbd-945a-88be3464de83"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:57.907755 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-efabac62-9ba4-4aef-b5d7-7fe6dadf1479 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:57.920854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efabac62-9ba4-4aef-b5d7-7fe6dadf1479 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:57.921464 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efabac62-9ba4-4aef-b5d7-7fe6dadf1479 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:57.922513 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efabac62-9ba4-4aef-b5d7-7fe6dadf1479 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:57.923187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efabac62-9ba4-4aef-b5d7-7fe6dadf1479 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:58.268532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-efabac62-9ba4-4aef-b5d7-7fe6dadf1479 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370317 Aug 01 22:47:58.269634 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 296/568] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:47:57 2022] POST /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:47:58.302521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:58.305986 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:58.326837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:58.327741 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:58.329320 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:58.331159 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:58.645658 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:58.659344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9f5a6d5b-8fdc-40e4-a707-1802337cf7a8 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1318 microversion: 2.1 time: 0.361429 Aug 01 22:47:58.660276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 273/569] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:58 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:47:58.811313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-41a2257d-299d-40e0-8d3c-f65d0e5cbf95 req-54cc70ef-8490-4b4d-8e91-1b586d9182b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ee44d7-500e-4be5-9929-ba7a287336c2", "tag": "13a4eddc-b655-4b2d-a35a-572b8b003c53"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:47:58.823580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-41a2257d-299d-40e0-8d3c-f65d0e5cbf95 req-54cc70ef-8490-4b4d-8e91-1b586d9182b1 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:58.824023 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-41a2257d-299d-40e0-8d3c-f65d0e5cbf95 req-54cc70ef-8490-4b4d-8e91-1b586d9182b1 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:58.850233 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-41a2257d-299d-40e0-8d3c-f65d0e5cbf95 req-54cc70ef-8490-4b4d-8e91-1b586d9182b1 service nova] Creating event network-changed:13a4eddc-b655-4b2d-a35a-572b8b003c53 for instance b0ee44d7-500e-4be5-9929-ba7a287336c2 on hv-cinder-85164 Aug 01 22:47:58.861584 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-41a2257d-299d-40e0-8d3c-f65d0e5cbf95 req-54cc70ef-8490-4b4d-8e91-1b586d9182b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057919 Aug 01 22:47:58.862628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 297/570] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:47:59.688245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:47:59.689142 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:47:59.696053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:59.696491 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:59.697276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:47:59.697731 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:47:59.867867 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:47:59.875878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-45f8520f-1792-4ebe-a08e-52c3723dafeb tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1318 microversion: 2.1 time: 0.192032 Aug 01 22:47:59.876469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 274/571] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:47:59 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:00.899074 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:00.899996 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:00.901610 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:00.908822 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:00.909342 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:00.910232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:00.910660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:01.076552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:01.088459 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-39259744-2014-4e1e-8c8a-a4687ee9d63b tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1318 microversion: 2.1 time: 0.194556 Aug 01 22:48:01.089068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 298/572] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:00 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:02.115956 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:02.116509 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:02.123739 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:02.124184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:02.124966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:02.125380 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:02.274353 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:02.282290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a0eba3b2-4c66-4761-9269-961f67e335ff tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1318 microversion: 2.1 time: 0.173323 Aug 01 22:48:02.282929 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 275/573] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:02 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:03.305261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:03.309125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:03.313846 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:03.314490 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:03.315410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:03.315843 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:03.374063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-27b51710-ef0f-4ee0-8dde-c3c99c258c6e req-5571a2a8-8184-42b2-9a35-d75c86614a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ee44d7-500e-4be5-9929-ba7a287336c2", "name": "network-vif-plugged", "status": "completed", "tag": "13a4eddc-b655-4b2d-a35a-572b8b003c53"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:03.380634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:03.387076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-27b51710-ef0f-4ee0-8dde-c3c99c258c6e req-5571a2a8-8184-42b2-9a35-d75c86614a23 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:03.387609 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-27b51710-ef0f-4ee0-8dde-c3c99c258c6e req-5571a2a8-8184-42b2-9a35-d75c86614a23 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:03.403001 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-27b51710-ef0f-4ee0-8dde-c3c99c258c6e req-5571a2a8-8184-42b2-9a35-d75c86614a23 service nova] Creating event network-vif-plugged:13a4eddc-b655-4b2d-a35a-572b8b003c53 for instance b0ee44d7-500e-4be5-9929-ba7a287336c2 on hv-cinder-85164 Aug 01 22:48:03.408189 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-27b51710-ef0f-4ee0-8dde-c3c99c258c6e req-5571a2a8-8184-42b2-9a35-d75c86614a23 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037822 Aug 01 22:48:03.409344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 276/574] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:48:03.482263 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:03.492513 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-80d00cc2-bed9-4723-8230-c5c94470ee24 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1318 microversion: 2.1 time: 0.191474 Aug 01 22:48:03.493697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 299/575] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:03 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:04.522128 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:04.522831 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:04.529841 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:04.530281 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:04.531046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:04.531463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:04.682808 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:04.692383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e0383577-016d-4e2d-b608-39db4a3ca22e tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1318 microversion: 2.1 time: 0.174762 Aug 01 22:48:04.693077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 277/576] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:04 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:05.717974 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:05.718619 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:05.726367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:05.726810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:05.727584 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:05.728014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:05.878715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:05.888341 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-670fd793-d09f-4907-b851-bef00c257694 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1507 microversion: 2.1 time: 0.174601 Aug 01 22:48:05.888929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 300/577] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:05 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:05.915823 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1436a686-669f-41ce-a1fc-d795f3eee174 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "074a9678-d521-4053-940d-59718f75b71b", "device": "/dev/sdb"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:05.919221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1436a686-669f-41ce-a1fc-d795f3eee174 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:05.926841 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1436a686-669f-41ce-a1fc-d795f3eee174 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:05.927361 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1436a686-669f-41ce-a1fc-d795f3eee174 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:05.928178 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1436a686-669f-41ce-a1fc-d795f3eee174 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:05.928644 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1436a686-669f-41ce-a1fc-d795f3eee174 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:06.096040 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:06.228077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1436a686-669f-41ce-a1fc-d795f3eee174 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "POST /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319336 Aug 01 22:48:06.228944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 278/578] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:48:05 2022] POST /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:06.996413 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:06.998883 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:07.000835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:07.001487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:07.012244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:07.013239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:07.014654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:07.015398 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:07.042139 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lazy-loading 'flavor' on Instance uuid 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:48:07.229169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1107b264-a18a-475f-8296-2b9d51f556b8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/action" status: 200 len: 32 microversion: 2.1 time: 0.239043 Aug 01 22:48:07.229915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 301/579] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:48:06 2022] POST /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:48:07.241064 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:07.241808 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:07.248564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:07.249021 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:07.249899 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:07.250612 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:07.512595 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:07.522348 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-03096dcf-7436-4c3e-a81f-db7a9eb28284 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.285969 Aug 01 22:48:07.522959 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 279/580] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:07 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:08.558182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:08.558867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:08.565350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:08.565820 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:08.566589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:08.567015 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:08.718005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:08.726451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f017077a-72c6-403c-b782-2100d5216e4c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.173265 Aug 01 22:48:08.727063 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 302/581] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:08 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:09.577586 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9f118181-fc16-497e-ad91-4dd3fe0b9f0e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:09.578302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9f118181-fc16-497e-ad91-4dd3fe0b9f0e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:09.584883 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f118181-fc16-497e-ad91-4dd3fe0b9f0e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:09.585343 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f118181-fc16-497e-ad91-4dd3fe0b9f0e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:09.586563 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f118181-fc16-497e-ad91-4dd3fe0b9f0e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:09.586883 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f118181-fc16-497e-ad91-4dd3fe0b9f0e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:09.617894 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9f118181-fc16-497e-ad91-4dd3fe0b9f0e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments/c247d77b-e1d7-4c8c-964c-91a8f1c79906" status: 200 len: 194 microversion: 2.20 time: 0.044117 Aug 01 22:48:09.618502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 280/582] 10.222.0.47 () {60 vars in 1454 bytes} [Mon Aug 1 22:48:09 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments/c247d77b-e1d7-4c8c-964c-91a8f1c79906 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:48:09.689831 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:09.690597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:09.698941 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:09.699560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:09.700402 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:09.700908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:09.749856 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:09.750936 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:09.759390 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:09.759842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:09.760631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:09.761073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:09.938226 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:09.952600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bc7300c8-5c61-43e8-92e2-13b2b54e5333 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.207372 Aug 01 22:48:09.953664 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 281/583] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:09 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:10.080966 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lazy-loading 'services' on Instance uuid 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:48:10.239989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0967f128-c5da-458d-8a64-30cc46ec519e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments/c247d77b-e1d7-4c8c-964c-91a8f1c79906" status: 202 len: 0 microversion: 2.20 time: 0.554267 Aug 01 22:48:10.240873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 303/584] 10.222.0.47 () {60 vars in 1457 bytes} [Mon Aug 1 22:48:09 2022] DELETE /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments/c247d77b-e1d7-4c8c-964c-91a8f1c79906 => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:48:10.251117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8019f5b3-3838-4eb7-a947-350fa463d8da tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:10.253358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8019f5b3-3838-4eb7-a947-350fa463d8da tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:10.259941 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8019f5b3-3838-4eb7-a947-350fa463d8da tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:10.260785 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8019f5b3-3838-4eb7-a947-350fa463d8da tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:10.261212 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8019f5b3-3838-4eb7-a947-350fa463d8da tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:10.262524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8019f5b3-3838-4eb7-a947-350fa463d8da tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:10.302217 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8019f5b3-3838-4eb7-a947-350fa463d8da tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055704 Aug 01 22:48:10.303195 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 282/585] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 1 22:48:10 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:48:10.989505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:10.990456 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:10.999000 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:10.999443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:11.000202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:11.000629 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:11.149435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:11.158373 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-74501cfb-a51a-42ca-ba2f-1f12bb006a70 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.174438 Aug 01 22:48:11.158950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 304/586] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:10 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:11.316527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3cc6455c-8980-4c86-904d-b4166e087bf3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:11.318647 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3cc6455c-8980-4c86-904d-b4166e087bf3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:11.325897 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cc6455c-8980-4c86-904d-b4166e087bf3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:11.326355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cc6455c-8980-4c86-904d-b4166e087bf3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:11.327169 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cc6455c-8980-4c86-904d-b4166e087bf3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:11.327632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cc6455c-8980-4c86-904d-b4166e087bf3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:11.360083 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3cc6455c-8980-4c86-904d-b4166e087bf3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047818 Aug 01 22:48:11.360672 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 283/587] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 1 22:48:11 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:48:12.179554 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:12.180390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:12.187361 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:12.187815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:12.188850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:12.189487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:12.344813 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:12.359727 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-46ac2ff4-f970-4646-aa74-7ee5e15766c8 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.183767 Aug 01 22:48:12.360791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 305/588] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:12 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:12.386583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-687e04c3-0472-4b9d-89df-0bc212571c41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:12.389284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-687e04c3-0472-4b9d-89df-0bc212571c41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:12.399417 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-687e04c3-0472-4b9d-89df-0bc212571c41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:12.399863 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-687e04c3-0472-4b9d-89df-0bc212571c41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:12.400833 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-687e04c3-0472-4b9d-89df-0bc212571c41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:12.403850 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-687e04c3-0472-4b9d-89df-0bc212571c41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:12.444456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-687e04c3-0472-4b9d-89df-0bc212571c41 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066034 Aug 01 22:48:12.445028 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 284/589] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 1 22:48:12 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:48:13.396123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:13.396999 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:13.405810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:13.406111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:13.407105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:13.407333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:13.461927 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4663a7c3-150f-493c-98b9-6a107d2d1442 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:13.465294 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4663a7c3-150f-493c-98b9-6a107d2d1442 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:13.473229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4663a7c3-150f-493c-98b9-6a107d2d1442 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:13.473851 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4663a7c3-150f-493c-98b9-6a107d2d1442 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:13.474947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4663a7c3-150f-493c-98b9-6a107d2d1442 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:13.475479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4663a7c3-150f-493c-98b9-6a107d2d1442 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:13.495531 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:13.512265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4663a7c3-150f-493c-98b9-6a107d2d1442 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055863 Aug 01 22:48:13.513026 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 285/590] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 1 22:48:13 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:48:13.593169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:13.602216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8916ac2b-1604-4c47-bd59-51bcbac91fe6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.210693 Aug 01 22:48:13.603209 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 306/591] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:13 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:14.528125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-90d7a863-da8b-4605-9fe9-40fa5664b6a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:14.530307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-90d7a863-da8b-4605-9fe9-40fa5664b6a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:14.537204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-90d7a863-da8b-4605-9fe9-40fa5664b6a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.537697 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-90d7a863-da8b-4605-9fe9-40fa5664b6a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.538480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-90d7a863-da8b-4605-9fe9-40fa5664b6a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.538917 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-90d7a863-da8b-4605-9fe9-40fa5664b6a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.571442 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-90d7a863-da8b-4605-9fe9-40fa5664b6a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047343 Aug 01 22:48:14.572137 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 286/592] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 1 22:48:14 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:14.624177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:14.624894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:14.631909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.632487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.633390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.633862 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.636655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:14.637327 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:14.651146 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.651734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.652406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.652874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.682333 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Going to try to terminate instance {{(pid=124356) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:48:14.768090 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e086b409-5c36-49bc-aa4e-3abc70d4358e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 204 len: 0 microversion: 2.20 time: 0.135359 Aug 01 22:48:14.768682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 287/593] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 1 22:48:14 2022] DELETE /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 22:48:14.777904 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:14.778594 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:14.784760 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.785292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.786009 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:14.786440 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:14.801312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:14.810000 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-be78ef4a-0d10-4818-9308-f7664e994ce4 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.189411 Aug 01 22:48:14.810466 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 307/594] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:14 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:15.274830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:15.290375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:15.293588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:15.295809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ad771eba-3e8d-4147-b648-701f0804658f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.521910 Aug 01 22:48:15.296855 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 288/595] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:14 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:48:15.832644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:15.833276 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:15.840219 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:15.840616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:15.841392 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:15.841847 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:15.983117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:15.991629 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3cfe9a13-730d-4b5b-a6be-7ad902d1bacc tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.162889 Aug 01 22:48:15.992212 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 308/596] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:15 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:16.321304 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:16.322162 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:16.328933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:16.329375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:16.330191 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:16.330623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:16.477608 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:16.489686 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:16.491205 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:16.492366 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d33ff639-ea0b-4441-ad14-a83610e0c469 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.175242 Aug 01 22:48:16.492957 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 289/597] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:16 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:17.014223 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:17.014850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:17.021968 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:17.022419 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:17.023238 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:17.023774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:17.028409 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:17.355900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:17.364712 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0e6dbec4-9108-479f-a355-9d7445f1f8f7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.354328 Aug 01 22:48:17.365296 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 309/598] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:17 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:17.520049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:17.521041 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:17.532117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:17.532666 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:17.534000 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:17.534723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:17.745303 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:17.757727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:17.759398 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:17.760664 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1f41bf67-c904-465b-b313-162735df3ec1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.247506 Aug 01 22:48:17.761240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 290/599] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:17 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:18.388249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:18.388878 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:18.396506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:18.396952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:18.397784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:18.398215 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:18.563405 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:18.573966 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9163c33f-243c-426c-b65f-4d282f1d9c33 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.190237 Aug 01 22:48:18.574554 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 310/600] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:18 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:18.796962 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:18.797626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:18.804632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:18.805092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:18.805905 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:18.806343 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:18.959630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:18.969621 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:18.971095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:18.972403 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2d2b94e6-0b57-450d-8ec1-1e4a10db1d54 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.179416 Aug 01 22:48:18.972947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 291/601] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:18 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:48:19.600719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:19.601397 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:19.608420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:19.608861 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:19.609621 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:19.610064 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:19.755574 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:19.768846 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-deaaa7c4-5645-42a8-a550-139d65c1f330 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.171915 Aug 01 22:48:19.769758 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 311/602] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:19 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:19.996723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:19.997458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:20.004889 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:20.005348 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:20.006403 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:20.006854 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:20.149762 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:20.162555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:20.164780 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:20.166061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3cf03996-4368-4a63-b1c1-4d7e919747cd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.173550 Aug 01 22:48:20.166629 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 292/603] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:19 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:20.800894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:20.801576 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:20.808950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:20.809434 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:20.810245 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:20.810662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:20.956967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:20.965825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1bbd9e9b-4892-485e-80fb-d2b014cda041 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.169575 Aug 01 22:48:20.966416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 312/604] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:20 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:21.189376 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:21.190065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:21.197123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:21.197598 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:21.198389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:21.198824 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:21.342691 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:21.354915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:21.356418 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:21.357820 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8a864725-4b0d-45fc-bc85-89a3800091c0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.172335 Aug 01 22:48:21.358221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 293/605] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:21 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:21.988251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:21.988903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:21.996361 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:21.996802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:21.997617 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:21.998220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:22.165550 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:22.174232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-16695576-81cd-4e29-b5cd-bbe9bb084b4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.189706 Aug 01 22:48:22.174841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 313/606] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:21 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:22.387736 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:22.388961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:22.404443 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:22.405587 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:22.406569 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:22.407076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:22.701682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:22.713471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:22.715187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:22.716428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f260c2a9-6729-46a3-8b80-25b29158c091 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1724 microversion: 2.20 time: 0.336297 Aug 01 22:48:22.717002 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 294/607] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:22 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:22.856805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 22:48:22.857183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Mon Aug 1 22:48:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 22:48:23.208575 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:23.209626 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:23.219209 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:23.220565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:23.221384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:23.221857 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:23.385452 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:23.395349 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2da8fa14-e9bf-4f4f-a930-ab630d2da4c3 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.190573 Aug 01 22:48:23.404533 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 314/608] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:23 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:23.542923 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-57183cb2-10f0-487e-9f5a-e3780db234a9 req-ddf45692-b1be-48d1-96a5-6fe98a7ed753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d", "name": "network-vif-deleted", "tag": "0910ddf7-1491-401d-8e5a-8a12e83a6b3f"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:23.558438 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-57183cb2-10f0-487e-9f5a-e3780db234a9 req-ddf45692-b1be-48d1-96a5-6fe98a7ed753 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:23.558884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-57183cb2-10f0-487e-9f5a-e3780db234a9 req-ddf45692-b1be-48d1-96a5-6fe98a7ed753 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:23.576789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-57183cb2-10f0-487e-9f5a-e3780db234a9 req-ddf45692-b1be-48d1-96a5-6fe98a7ed753 service nova] Creating event network-vif-deleted:0910ddf7-1491-401d-8e5a-8a12e83a6b3f for instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d on hv-cinder-85164 Aug 01 22:48:23.586620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-57183cb2-10f0-487e-9f5a-e3780db234a9 req-ddf45692-b1be-48d1-96a5-6fe98a7ed753 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046990 Aug 01 22:48:23.587707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 295/609] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:23.744025 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:23.744637 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:23.751943 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:23.752438 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:23.753308 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:23.753718 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:23.804750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:23.805424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:23.806163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lazy-loading 'fault' on Instance uuid 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:48:23.882033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:23.891015 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:23.892872 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:23.894314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-742ae473-bee4-4472-aa40-fc4cc5787823 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 200 len: 1371 microversion: 2.20 time: 0.155376 Aug 01 22:48:23.895130 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 315/610] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:23 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:24.434642 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:24.436091 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:24.447296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:24.448047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:24.449376 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:24.450173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:24.626483 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:24.635614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ae420998-bd8e-4fbd-88c7-83eb9a32a885 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.209091 Aug 01 22:48:24.636184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 296/611] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:24 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:24.924669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:24.928205 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:24.939201 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:24.940268 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:24.941303 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:24.941970 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:24.965717 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] HTTP exception thrown: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Request method failure captured: Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d HTTP/1.1 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcLhPohGbeO6MICRMWU5wqmJN2183om2-hSXa9UkS2qG35wbtp_uQcXpWw1bC3_9Nh7s108Rgd_BWQsik_y7cBNoxuP-KkV9RaLXh0Zl2dDhFPy02_9QGDI1h-IUBRsFxcGpAiwF4Rn9QPxbQ80FBsjXo6RFIX7lRnaUY7a0UQfnA8 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:48:24.967542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_96cf343ab1cd4658997298d18a083f29", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 527b7873931742049db9f44104396686 Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:48:24.969860 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d'} Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:48:24.970908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:48:24.973412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:24.976934 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Returning 404 to user: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:48:24.978069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-335a9a71-c938-42b6-88d5-25b0a3f34c21 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 404 len: 111 microversion: 2.20 time: 0.061268 Aug 01 22:48:24.978811 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 316/612] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:24 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:48:24.989237 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1dab297e-d568-4906-b499-7ebdcfe12e5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '.version_select at 0x7fc5419348b0>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:25.027919 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1dab297e-d568-4906-b499-7ebdcfe12e5d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997371231" status: 204 len: 0 microversion: 2.20 time: 0.043128 Aug 01 22:48:25.030277 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 297/613] 10.222.0.47 () {60 vars in 1259 bytes} [Mon Aug 1 22:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997371231 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 22:48:25.658403 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:25.659012 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:25.668220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:25.670839 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:25.670839 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:25.670839 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:25.820740 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:25.830405 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7070c73d-30e6-46c9-963c-ea1dbc395829 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.176870 Aug 01 22:48:25.831682 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 317/614] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:25 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:25.921456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f642f1a1-212e-423b-b85d-87a9bf1f8f7e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'create', calling method: .version_select at 0x7fc541898ca0>, body: {"keypair": {"name": "tempest-keypair-655587982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFErxRBFmKkHze7V5FbW962jA/qrWCJ0KYFu/8VHM/KKaFSj782th1lk1Y3CrfDhxx+D/L+9247hBRYJOxNssnY64+5i4+85ScjRsupNUMaDe4DDJ4xHkmLhU3tvdqS5Q=="}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:25.937947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-f642f1a1-212e-423b-b85d-87a9bf1f8f7e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for project 96cf343ab1cd4658997298d18a083f29. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:48:25.942349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-f642f1a1-212e-423b-b85d-87a9bf1f8f7e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for user 527b7873931742049db9f44104396686 and project 96cf343ab1cd4658997298d18a083f29. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:48:25.966475 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f642f1a1-212e-423b-b85d-87a9bf1f8f7e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049439 Aug 01 22:48:25.967183 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 298/615] 10.222.0.47 () {62 vars in 1200 bytes} [Mon Aug 1 22:48:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 22:48:25.988865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:25.989603 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:25.996751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:25.997260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:25.998000 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:25.998425 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:26.107202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lazy-loading 'services' on Instance uuid b0ee44d7-500e-4be5-9929-ba7a287336c2 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:48:26.203661 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bb7b49b9-b705-491b-8da1-3ddd2adac0e0 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2/os-volume_attachments/074a9678-d521-4053-940d-59718f75b71b" status: 202 len: 0 microversion: 2.1 time: 0.218331 Aug 01 22:48:26.204283 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 318/616] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:48:25 2022] DELETE /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2/os-volume_attachments/074a9678-d521-4053-940d-59718f75b71b => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:48:26.855773 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:26.856431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:26.864405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:26.864988 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:26.866067 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:26.866665 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:27.089763 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:27.103232 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3c7b94a3-2648-489b-b4fd-6c7cbfd9640b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.251765 Aug 01 22:48:27.104093 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 299/617] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:26 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:27.400392 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:27.401069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:27.408719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:27.409197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:27.410020 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:27.410453 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:27.448430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:48:27.546293 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-885bf1a4-7b0a-4f8a-884a-cd7aebb896c5 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 204 len: 0 microversion: 2.1 time: 0.155409 Aug 01 22:48:27.547079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 319/618] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:48:27 2022] DELETE /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:48:27.561356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:27.564266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:27.575374 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:27.576130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:27.577484 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:27.578280 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:27.607510 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1762063357", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68a2d697-956d-438e-999f-17541428f4b3"}], "security_groups": [{"name": "tempest-securitygroup--760759365"}], "key_name": "tempest-keypair-655587982", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:27.735503 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:27.745057 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] validate_networks() for [('68a2d697-956d-438e-999f-17541428f4b3', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:48:27.746589 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3108f60b-adab-417e-ba0a-f10bdd8622f4 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1559 microversion: 2.1 time: 0.193355 Aug 01 22:48:27.747404 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 300/619] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:27 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:28.127240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:28.127958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:28.135408 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:28.135859 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:28.136654 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:28.137095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:28.240314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:48:28.240985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:48:28.241473 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:48:28.242112 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:48:28.242952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:48:28.255454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:28.255900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:28.256807 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:28.257328 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:28.277688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for project 96cf343ab1cd4658997298d18a083f29. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:48:28.290001 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Getting quotas for user 527b7873931742049db9f44104396686 and project 96cf343ab1cd4658997298d18a083f29. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:48:28.308294 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:28.314525 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:48:28.316930 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:48:28.326437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-21fe83e7-72a3-4faa-a710-e102ba95ebb2 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.204471 Aug 01 22:48:28.326784 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 301/620] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:28 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:28.374818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-45497777-a6a6-4624-b7ef-2b037e90d5dd tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.771708 Aug 01 22:48:28.375274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 320/621] 10.222.0.47 () {62 vars in 1188 bytes} [Mon Aug 1 22:48:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 01 22:48:28.386311 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9235d302-3542-408a-8223-dbb55ceadc16 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:28.386915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9235d302-3542-408a-8223-dbb55ceadc16 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:28.462033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9235d302-3542-408a-8223-dbb55ceadc16 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:28.470416 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9235d302-3542-408a-8223-dbb55ceadc16 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:28.472181 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9235d302-3542-408a-8223-dbb55ceadc16 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:28.473331 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9235d302-3542-408a-8223-dbb55ceadc16 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1281 microversion: 2.20 time: 0.091003 Aug 01 22:48:28.474279 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 302/622] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:28 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:28.770532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:28.771225 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:28.779461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:28.779917 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:28.780692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:28.781129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:28.941492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:28.954044 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-281ef7d8-c4f2-4f87-8eb1-b1a4b8c9bb9f tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1513 microversion: 2.1 time: 0.188663 Aug 01 22:48:28.954790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 321/623] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:28 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:29.348577 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:29.349198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:29.358119 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:29.358565 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:29.359335 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:29.359777 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:29.496480 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:29.497215 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:29.505840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:29.506360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:29.507220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:29.507577 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:29.507792 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:29.518802 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1fe9e8aa-ab3e-47ba-98ae-3afcf011ddd0 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.174350 Aug 01 22:48:29.519392 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 303/624] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:29 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:29.584140 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:29.593331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:29.594878 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:29.596038 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-07f967de-92cc-46a5-80c1-1ecdee07a332 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1285 microversion: 2.20 time: 0.103634 Aug 01 22:48:29.596681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 322/625] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:29 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:48:29.976445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:29.977410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:29.985118 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:29.986390 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:29.989100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:29.989100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:29.996612 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:30.187497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:30.198677 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-fffca1c2-79d5-4a21-90dc-9d922ffd4aa2 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1513 microversion: 2.1 time: 0.225967 Aug 01 22:48:30.199713 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 304/626] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:29 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:30.542744 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:30.543460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:30.550889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:30.551329 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:30.552122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:30.552552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:30.626818 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:30.627757 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:30.636521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:30.637708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:30.638584 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:30.639185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:30.733777 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:30.746169 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:30.748559 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:30.750861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:30.752609 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c451615a-1a87-49a2-8f00-0ffae9e71faa tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1333 microversion: 2.20 time: 0.135519 Aug 01 22:48:30.753831 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 305/627] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:30 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1333 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:30.761433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-88cac954-a9a9-4d26-84c5-033d41c5eca7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.222959 Aug 01 22:48:30.762422 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 323/628] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:30 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:31.221132 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:31.224146 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:31.229922 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:31.230371 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:31.231144 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:31.231572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:31.527753 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-e599a710-8dab-449d-81b0-ee82068a3b59 req-55c93c19-fee4-4263-b250-6ef611948132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ee44d7-500e-4be5-9929-ba7a287336c2", "name": "network-vif-deleted", "tag": "13a4eddc-b655-4b2d-a35a-572b8b003c53"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:31.533598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:31.541810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-e599a710-8dab-449d-81b0-ee82068a3b59 req-55c93c19-fee4-4263-b250-6ef611948132 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:31.542244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-e599a710-8dab-449d-81b0-ee82068a3b59 req-55c93c19-fee4-4263-b250-6ef611948132 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:31.556118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-e599a710-8dab-449d-81b0-ee82068a3b59 req-55c93c19-fee4-4263-b250-6ef611948132 service nova] Creating event network-vif-deleted:13a4eddc-b655-4b2d-a35a-572b8b003c53 for instance b0ee44d7-500e-4be5-9929-ba7a287336c2 on hv-cinder-85164 Aug 01 22:48:31.565698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-e599a710-8dab-449d-81b0-ee82068a3b59 req-55c93c19-fee4-4263-b250-6ef611948132 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041486 Aug 01 22:48:31.567255 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 324/629] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:48:31.569046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:31.580907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-097a43a2-bb20-4c4b-9773-8f84cf90b6ed tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1513 microversion: 2.1 time: 0.364002 Aug 01 22:48:31.581699 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 306/630] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:31 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:31.778948 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:31.779764 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:31.785533 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:31.786754 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:31.787766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:31.788237 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:31.788997 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:31.789609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:31.794275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:31.794557 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:31.795308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:31.795818 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:31.796240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:31.874985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:31.884722 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:31.886299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:31.887435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fb7d8c39-7b71-425a-a437-dc4cbaf69a4a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1339 microversion: 2.20 time: 0.113043 Aug 01 22:48:31.887998 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 325/631] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:31 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:31.963224 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:31.972535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-81ca0946-5bed-4908-82c9-d6c5074616cf tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1735 microversion: 2.1 time: 0.191152 Aug 01 22:48:31.973134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 307/632] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:31 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:32.606116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:32.606703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:32.613650 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:32.614095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:32.615226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:32.615388 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:32.653867 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:32.654323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:32.654794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lazy-loading 'fault' on Instance uuid b0ee44d7-500e-4be5-9929-ba7a287336c2 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:48:32.701200 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c362f3a63b944fbcbea080d55c8fdfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b04d30f1426408ba5c8fa0238982089', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:32.709837 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-adc0a98d-948a-495b-8a5b-eb0f2fafa34a tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 200 len: 1308 microversion: 2.1 time: 0.108122 Aug 01 22:48:32.710818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 326/633] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:32 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:32.911302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:32.912686 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:32.928759 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:32.930100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:32.930992 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:32.931533 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:32.995552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:32.996213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:33.007671 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.008317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.009430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.010076 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.157163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:33.166137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cf5e6923-6d44-4f17-b68e-9c307474406f tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1715 microversion: 2.1 time: 0.175140 Aug 01 22:48:33.166707 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 327/634] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:32 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1715 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:33.229461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:33.229970 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:33.236172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.236616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.237383 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.237857 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.334249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] HTTP exception thrown: Cannot 'detach_volume' instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 while it is in vm_state rescued Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Request method failure captured: Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments/fdbbf76b-2a39-4dbd-945a-88be3464de83 HTTP/1.1 Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcFvf4aw_URmCUfiD67OVb-quybPOxELhtN9IfD7JvucjoqvMa7hcXurP0YYYB2IjO-LZ4mOypyLc0KDCM5Zw-dKimkoPzcfQWwHVRp6lWGSpEwbTlR4xmzyg1YDu_GrlBa30tR-aXXhWO97gf_LgUMmGqk-dNxSaBsn7DHf2A1kjI Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:48:33.336078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a6afb01194249d6af1c369e9f109b72", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: a8bbeb0e65a54b1199d0fe718168af70 Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:48:33.337766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Cannot 'detach_volume' instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 while it is in vm_state rescued Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'server_id': '40608dc4-7e0c-4f8e-83cc-8f514e3ca783', 'id': 'fdbbf76b-2a39-4dbd-945a-88be3464de83'} Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:48:33.338821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 while it is in vm_state rescued Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 while it is in vm_state rescued Aug 01 22:48:33.340670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.342029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:33.343027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Returning 409 to user: Cannot 'detach_volume' instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 while it is in vm_state rescued {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:48:33.344818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d5b9e41a-3b4f-4f7e-89c9-52a71b0797eb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments/fdbbf76b-2a39-4dbd-945a-88be3464de83" status: 409 len: 152 microversion: 2.1 time: 0.119140 Aug 01 22:48:33.345501 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 328/635] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:48:33 2022] DELETE /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments/fdbbf76b-2a39-4dbd-945a-88be3464de83 => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 22:48:33.355299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e3cc8f6e-1730-49ed-9607-120819cfb1bd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:33.355836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e3cc8f6e-1730-49ed-9607-120819cfb1bd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:33.356972 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:33.359810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:33.362091 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3db97579-1a41-4c61-9f4a-f966095e7092 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.454539 Aug 01 22:48:33.363691 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3cc8f6e-1730-49ed-9607-120819cfb1bd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.363881 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 308/636] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:32 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:33.374093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3cc8f6e-1730-49ed-9607-120819cfb1bd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.375000 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3cc8f6e-1730-49ed-9607-120819cfb1bd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.375466 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e3cc8f6e-1730-49ed-9607-120819cfb1bd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.450090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e3cc8f6e-1730-49ed-9607-120819cfb1bd tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "POST /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/action" status: 202 len: 0 microversion: 2.1 time: 0.098191 Aug 01 22:48:33.451705 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 329/637] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:48:33 2022] POST /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:48:33.459891 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:33.460442 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:33.462759 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:33.468826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.469340 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.470439 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.470908 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.734598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:33.735217 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] [instance: b0ee44d7-500e-4be5-9929-ba7a287336c2] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:33.742227 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.742678 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.743456 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:33.743887 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:33.759568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] HTTP exception thrown: Instance b0ee44d7-500e-4be5-9929-ba7a287336c2 could not be found. Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Request method failure captured: Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 HTTP/1.1 Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6Fe5lDkpeH0XTf79mati26eFEVOAYdJPYqyHhHhKWqsVHJKSx4TJoaMJ2NqQ2L2q0abEcshoAtd19YXx48HpUPszIQJOBVPEsH-LBLG_GttddNIy5PnAnpoOtMjumfG1tzjdYqan-Ru2YmEJfwGqx_egVSmKCTY5hcydefln22pAs1g Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 3b04d30f1426408ba5c8fa0238982089 Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesSnapshotTestJSON-873965519 Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:48:33.761231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b04d30f1426408ba5c8fa0238982089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b04d30f1426408ba5c8fa0238982089", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b04d30f1426408ba5c8fa0238982089"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b04d30f1426408ba5c8fa0238982089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesSnapshotTestJSON-873965519 Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 3b04d30f1426408ba5c8fa0238982089 Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-873965519 Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesSnapshotTestJSON-873965519-project Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: c362f3a63b944fbcbea080d55c8fdfa1 Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesSnapshotTestJSON-873965519-project Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance b0ee44d7-500e-4be5-9929-ba7a287336c2 could not be found. Aug 01 22:48:33.762761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'b0ee44d7-500e-4be5-9929-ba7a287336c2'} Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0ee44d7-500e-4be5-9929-ba7a287336c2 could not be found. Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:48:33.763523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0ee44d7-500e-4be5-9929-ba7a287336c2 could not be found. Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0ee44d7-500e-4be5-9929-ba7a287336c2 could not be found. Aug 01 22:48:33.764750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:33.765883 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] Returning 404 to user: Instance b0ee44d7-500e-4be5-9929-ba7a287336c2 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:48:33.765883 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e2aea81b-1011-4c12-8823-201778332e58 tempest-VolumesSnapshotTestJSON-873965519 tempest-VolumesSnapshotTestJSON-873965519-project] 10.222.0.47 "GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2" status: 404 len: 111 microversion: 2.1 time: 0.033803 Aug 01 22:48:33.765883 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 330/638] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:33 2022] GET /compute/v2.1/servers/b0ee44d7-500e-4be5-9929-ba7a287336c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:48:33.858668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:33.868452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b2e370d4-1445-4179-8006-dbf3342f9248 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1723 microversion: 2.1 time: 0.412495 Aug 01 22:48:33.869373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 309/639] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:33 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:34.391413 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:34.392142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:34.402002 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:34.403363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:34.406055 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:34.406055 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:34.519505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-59ab239a-1935-4c12-bf24-a381cc1565f5 req-1d47f0d4-9b43-42a6-8f70-017fd951cb8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d46d04-c425-4550-81d2-b81ae445092c", "tag": "8337104d-1ac5-46da-a5b2-bf7d7c573998"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:34.535808 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-59ab239a-1935-4c12-bf24-a381cc1565f5 req-1d47f0d4-9b43-42a6-8f70-017fd951cb8e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:34.536796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-59ab239a-1935-4c12-bf24-a381cc1565f5 req-1d47f0d4-9b43-42a6-8f70-017fd951cb8e service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:34.553514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-59ab239a-1935-4c12-bf24-a381cc1565f5 req-1d47f0d4-9b43-42a6-8f70-017fd951cb8e service nova] Creating event network-changed:8337104d-1ac5-46da-a5b2-bf7d7c573998 for instance b9d46d04-c425-4550-81d2-b81ae445092c on hv-cinder-85164 Aug 01 22:48:34.561927 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-59ab239a-1935-4c12-bf24-a381cc1565f5 req-1d47f0d4-9b43-42a6-8f70-017fd951cb8e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053401 Aug 01 22:48:34.563008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 310/640] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:34.582474 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:34.591274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:34.592763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:34.595312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ae73d7c0-af6f-425f-8936-668764aea42c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.208332 Aug 01 22:48:34.595312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 331/641] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:34 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:34.890709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:34.891441 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:34.898049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:34.898534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:34.899323 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:34.899760 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:35.046338 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:35.054662 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1b651054-3707-43fb-aa71-5d572ec536c7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1723 microversion: 2.1 time: 0.168279 Aug 01 22:48:35.055757 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 311/642] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:34 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:35.618053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:35.618655 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:35.625810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:35.626261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:35.627033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:35.627493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:35.774186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:35.782580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:35.784047 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:35.785147 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0eb6c09c-aaeb-4f08-8583-f9fc97161aee tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.171314 Aug 01 22:48:35.785746 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 332/643] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:35 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:36.077265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:36.077947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:36.085113 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:36.085574 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:36.086372 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:36.086806 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:36.227171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:36.235765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0e9c68b7-a26a-4d00-9997-a8efcedd7d56 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1723 microversion: 2.1 time: 0.162358 Aug 01 22:48:36.236362 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 312/644] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:36 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:36.809243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:36.809877 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:36.816965 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:36.817417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:36.818221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:36.818657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:36.954522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:36.963085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:36.964559 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:36.965664 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-85afbb36-70f1-41f3-9d84-e217b3be32b0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.160625 Aug 01 22:48:36.966220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 333/645] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:36 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:37.257431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:37.258125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:37.265121 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:37.265588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:37.266372 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:37.266829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:37.408581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:37.417373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-992f5d9a-04c5-4f78-91e1-edc2ec7d921d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1723 microversion: 2.1 time: 0.163828 Aug 01 22:48:37.418034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 313/646] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:37 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:37.989085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:37.989750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:37.997122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:37.997581 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:37.998357 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:37.998780 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:38.142571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:38.153301 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:38.154868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:38.155982 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aaec8653-c732-4a6b-99da-11f54a3f7751 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.170896 Aug 01 22:48:38.156521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 334/647] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:37 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:38.443775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:38.444886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:38.457057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:38.457708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:38.458659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:38.459355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:38.477085 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:38.682884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:38.693262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1a46d6c6-0935-491a-bc49-ad3a71e8a083 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1723 microversion: 2.1 time: 0.257145 Aug 01 22:48:38.693933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 314/648] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:38 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:39.182681 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:39.183634 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:39.187057 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:39.188105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:39.200256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:39.201011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:39.202476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:39.203182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:39.358763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:39.368468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:39.369964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:39.371057 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-33b23e32-71ab-431e-8df5-12a70edf12fc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.195826 Aug 01 22:48:39.371767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 335/649] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:39 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:39.715494 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:39.716122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:39.723822 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:39.724267 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:39.725044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:39.725473 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:39.880585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:39.889331 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-82450998-3514-42c2-b8fa-b34aea410e9b tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1729 microversion: 2.1 time: 0.177685 Aug 01 22:48:39.890512 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 315/650] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:39 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:39.911285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bfbbe178-3b2f-4c0f-befe-403734a190ed tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:39.911788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bfbbe178-3b2f-4c0f-befe-403734a190ed tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:39.918307 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfbbe178-3b2f-4c0f-befe-403734a190ed tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:39.918751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfbbe178-3b2f-4c0f-befe-403734a190ed tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:39.919526 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfbbe178-3b2f-4c0f-befe-403734a190ed tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:39.921715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfbbe178-3b2f-4c0f-befe-403734a190ed tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:40.059311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bfbbe178-3b2f-4c0f-befe-403734a190ed tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151853 Aug 01 22:48:40.059903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 336/651] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:48:39 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:48:40.396066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:40.396663 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:40.402920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:40.403356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:40.404112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:40.404555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:40.761309 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:40.770174 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:40.771692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:40.772819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-34caca1e-5c50-45c8-b535-5c56a58603bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.381715 Aug 01 22:48:40.773389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 316/652] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:40 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:41.799776 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:41.801154 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:41.811216 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:41.812047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:41.813418 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:41.814193 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:41.825096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-aeb0d2a6-923a-4d86-ae28-b862ec04b9e6 req-47cb20bc-32a9-496f-932d-d144327481f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40608dc4-7e0c-4f8e-83cc-8f514e3ca783", "tag": "cbe357ac-0ec9-4656-93e3-83c29a2e5708"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:41.843829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-aeb0d2a6-923a-4d86-ae28-b862ec04b9e6 req-47cb20bc-32a9-496f-932d-d144327481f3 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:41.844552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-aeb0d2a6-923a-4d86-ae28-b862ec04b9e6 req-47cb20bc-32a9-496f-932d-d144327481f3 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:41.862351 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-aeb0d2a6-923a-4d86-ae28-b862ec04b9e6 req-47cb20bc-32a9-496f-932d-d144327481f3 service nova] Creating event network-changed:cbe357ac-0ec9-4656-93e3-83c29a2e5708 for instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 on hv-cinder-85164 Aug 01 22:48:41.869212 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-aeb0d2a6-923a-4d86-ae28-b862ec04b9e6 req-47cb20bc-32a9-496f-932d-d144327481f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133709 Aug 01 22:48:41.870129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 337/653] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:42.065979 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:42.087423 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:42.090530 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:42.092413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-dc2680e3-8682-4579-9246-c94ac41065ed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.299348 Aug 01 22:48:42.093583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 317/654] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:41 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:48:43.117016 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:43.117892 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:43.125434 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:43.125933 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:43.126784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:43.127231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:43.525174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:43.538031 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:43.539737 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:43.540890 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-93adc061-ff16-4a75-9531-cdbebbf6418c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.428246 Aug 01 22:48:43.541532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 338/655] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:43 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:43.886443 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-97bf30c8-18e9-41aa-af9b-d8c125e8c222 req-2ffe51ff-2644-4d77-9eea-b3da519e5017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40608dc4-7e0c-4f8e-83cc-8f514e3ca783", "tag": "cbe357ac-0ec9-4656-93e3-83c29a2e5708"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:43.898273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-97bf30c8-18e9-41aa-af9b-d8c125e8c222 req-2ffe51ff-2644-4d77-9eea-b3da519e5017 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:43.898835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-97bf30c8-18e9-41aa-af9b-d8c125e8c222 req-2ffe51ff-2644-4d77-9eea-b3da519e5017 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:43.910772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-97bf30c8-18e9-41aa-af9b-d8c125e8c222 req-2ffe51ff-2644-4d77-9eea-b3da519e5017 service nova] Creating event network-changed:cbe357ac-0ec9-4656-93e3-83c29a2e5708 for instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 on hv-cinder-85164 Aug 01 22:48:43.918265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-97bf30c8-18e9-41aa-af9b-d8c125e8c222 req-2ffe51ff-2644-4d77-9eea-b3da519e5017 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036224 Aug 01 22:48:43.918892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 318/656] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:44.564111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:44.564710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:44.571657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:44.572130 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:44.572882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:44.573307 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:44.707478 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:44.715953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:44.717435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:44.718931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-abfc8ab1-e34a-41e3-b4d9-f52c5d2a2dc1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.158578 Aug 01 22:48:44.719497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 339/657] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:44 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:48:45.743206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:45.744228 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:45.751367 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:45.751817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:45.752603 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:45.753036 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:45.979389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:45.989174 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:45.990168 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:45.991304 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6f08a48b-b61e-4fd9-91dc-94c86b83f6a9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.253107 Aug 01 22:48:45.991871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 319/658] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:45 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:47.026089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:47.026673 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:47.033589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:47.034030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:47.034806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:47.035246 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:47.188194 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:47.197184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:47.198688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:47.199784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7c8db49a-0c39-47ef-884a-547ff2255252 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.177752 Aug 01 22:48:47.200397 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 340/659] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:47 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:47.852522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-9982a176-9e2c-4084-9e35-ba6629ac352f req-99546d9a-b1c8-414c-b8c5-5677a0473c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d46d04-c425-4550-81d2-b81ae445092c", "name": "network-vif-plugged", "status": "completed", "tag": "8337104d-1ac5-46da-a5b2-bf7d7c573998"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:47.863072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-9982a176-9e2c-4084-9e35-ba6629ac352f req-99546d9a-b1c8-414c-b8c5-5677a0473c89 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:47.863551 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-9982a176-9e2c-4084-9e35-ba6629ac352f req-99546d9a-b1c8-414c-b8c5-5677a0473c89 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:47.876675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-9982a176-9e2c-4084-9e35-ba6629ac352f req-99546d9a-b1c8-414c-b8c5-5677a0473c89 service nova] Creating event network-vif-plugged:8337104d-1ac5-46da-a5b2-bf7d7c573998 for instance b9d46d04-c425-4550-81d2-b81ae445092c on hv-cinder-85164 Aug 01 22:48:47.881698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-9982a176-9e2c-4084-9e35-ba6629ac352f req-99546d9a-b1c8-414c-b8c5-5677a0473c89 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033336 Aug 01 22:48:47.882329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 320/660] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:48.224487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:48.225174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:48.236979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.237831 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:48.239205 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.240055 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:48.400141 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:48.409120 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:48.410710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:48.412255 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-89c5fe3d-e168-46d6-978b-f517d2c566bf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.191858 Aug 01 22:48:48.412989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 341/661] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:48 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:48.615687 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e23c4b0f-c354-4668-b33c-c8cff5e19d5e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:48.618812 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e23c4b0f-c354-4668-b33c-c8cff5e19d5e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:48.627627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e23c4b0f-c354-4668-b33c-c8cff5e19d5e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.628297 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e23c4b0f-c354-4668-b33c-c8cff5e19d5e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:48.629263 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e23c4b0f-c354-4668-b33c-c8cff5e19d5e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.629841 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e23c4b0f-c354-4668-b33c-c8cff5e19d5e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:48.670482 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e23c4b0f-c354-4668-b33c-c8cff5e19d5e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058898 Aug 01 22:48:48.671419 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 321/662] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:48:48 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:48:48.750437 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:48.750924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:48.757278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.757815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:48.758633 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.759071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:48.763382 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:48.787549 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:48:48.868290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-612c501b-9092-4ce3-98a7-851a50b52fba tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 204 len: 0 microversion: 2.1 time: 0.121459 Aug 01 22:48:48.868922 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 342/663] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:48:48 2022] DELETE /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:48:48.878249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:48.878971 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:48.885900 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.886359 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:48.887123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:48.887548 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:49.036288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:49.040256 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:48:49.045243 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ed498420-4328-424b-9ff7-0948ecf36300 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1672 microversion: 2.1 time: 0.171225 Aug 01 22:48:49.045877 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 322/664] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:48 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:49.439257 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:49.440174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:49.447871 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:49.448253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:49.449263 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:49.449720 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:49.622445 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:49.636968 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:49.639899 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:49.642096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4c78c76d-3825-4d4e-b2bf-431512d7069f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.207661 Aug 01 22:48:49.643146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 343/665] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:49 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:50.069678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:50.070575 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:50.078321 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:50.078772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:50.079565 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:50.080065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:50.241158 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:50.250986 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f8ade2c8-a875-497d-b725-5df9f05bb649 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1672 microversion: 2.1 time: 0.187769 Aug 01 22:48:50.252003 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 323/666] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:50 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:50.683131 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:50.684081 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:50.694550 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:50.695278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:50.696394 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:50.697141 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:50.875218 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:50.883999 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:50.885479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:50.886662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e8a38390-e7bc-4498-a82e-24a225d36038 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1406 microversion: 2.20 time: 0.210089 Aug 01 22:48:50.887243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 344/667] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:50 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:51.274817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:51.275710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:51.287688 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:51.288141 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:51.289463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:51.290398 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:51.431854 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:51.440087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-299cdc3a-38c2-4c0b-b364-d237a7c4a681 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1672 microversion: 2.1 time: 0.170655 Aug 01 22:48:51.440652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 324/668] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:51 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:51.910123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:51.910745 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:51.917870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:51.918314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:51.919310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:51.919743 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:52.080610 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:52.092853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:52.096297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:52.098719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-05f71a00-ca9a-4d21-9f30-70a7f397af82 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1598 microversion: 2.20 time: 0.192723 Aug 01 22:48:52.099794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 345/669] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:48:51 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:48:52.123455 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-58124fd0-d6f7-45d0-a32f-5e4c0d91226a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:52.123455 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-58124fd0-d6f7-45d0-a32f-5e4c0d91226a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:52.129713 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-58124fd0-d6f7-45d0-a32f-5e4c0d91226a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:52.130155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-58124fd0-d6f7-45d0-a32f-5e4c0d91226a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:52.130972 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-58124fd0-d6f7-45d0-a32f-5e4c0d91226a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:52.131483 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-58124fd0-d6f7-45d0-a32f-5e4c0d91226a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:52.258721 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-58124fd0-d6f7-45d0-a32f-5e4c0d91226a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140085 Aug 01 22:48:52.259326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 325/670] 10.222.0.47 () {60 vars in 1316 bytes} [Mon Aug 1 22:48:52 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:48:52.462932 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:52.463878 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:52.470599 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:52.471046 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:52.471826 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:52.472256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:52.566723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:52.576157 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6df31c91-d95a-4511-b699-2b389980b98d tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1605 microversion: 2.1 time: 0.117256 Aug 01 22:48:52.590318 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 346/671] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:52 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1605 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:48:52.851799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-2707198b-c8f4-4fc6-ab5f-6ece84fa8d8b req-b86cb981-ee4e-4440-ab01-0dd5839dee4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909f43f2-82b3-496f-8561-f7e7e385a275", "name": "network-vif-deleted", "tag": "0314aed5-18ce-4da4-b33f-5fc8da44e112"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:52.869180 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-2707198b-c8f4-4fc6-ab5f-6ece84fa8d8b req-b86cb981-ee4e-4440-ab01-0dd5839dee4c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:52.869958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-2707198b-c8f4-4fc6-ab5f-6ece84fa8d8b req-b86cb981-ee4e-4440-ab01-0dd5839dee4c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:52.889958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-2707198b-c8f4-4fc6-ab5f-6ece84fa8d8b req-b86cb981-ee4e-4440-ab01-0dd5839dee4c service nova] Creating event network-vif-deleted:0314aed5-18ce-4da4-b33f-5fc8da44e112 for instance 909f43f2-82b3-496f-8561-f7e7e385a275 on hv-cinder-85164 Aug 01 22:48:52.897705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-2707198b-c8f4-4fc6-ab5f-6ece84fa8d8b req-b86cb981-ee4e-4440-ab01-0dd5839dee4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050339 Aug 01 22:48:52.899026 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 326/672] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:53.578660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-680abdf3-0ba2-48cf-aa37-08a74c02d827 req-1b78159f-fb20-4322-a5a9-3095cf6fad28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d46d04-c425-4550-81d2-b81ae445092c", "tag": "8337104d-1ac5-46da-a5b2-bf7d7c573998"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:53.589228 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-680abdf3-0ba2-48cf-aa37-08a74c02d827 req-1b78159f-fb20-4322-a5a9-3095cf6fad28 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:53.589692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-680abdf3-0ba2-48cf-aa37-08a74c02d827 req-1b78159f-fb20-4322-a5a9-3095cf6fad28 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:53.602437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:53.603542 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:53.606415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-680abdf3-0ba2-48cf-aa37-08a74c02d827 req-1b78159f-fb20-4322-a5a9-3095cf6fad28 service nova] Creating event network-changed:8337104d-1ac5-46da-a5b2-bf7d7c573998 for instance b9d46d04-c425-4550-81d2-b81ae445092c on hv-cinder-85164 Aug 01 22:48:53.612314 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:53.613089 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:53.613202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-680abdf3-0ba2-48cf-aa37-08a74c02d827 req-1b78159f-fb20-4322-a5a9-3095cf6fad28 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104673 Aug 01 22:48:53.614213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 347/673] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:48:53.617771 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:53.618485 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:53.657776 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:53.658429 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:53.659189 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lazy-loading 'fault' on Instance uuid 909f43f2-82b3-496f-8561-f7e7e385a275 {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:48:53.732643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:53.745373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-34905759-3a14-4de7-a2c5-66e4d104b39c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 200 len: 1328 microversion: 2.1 time: 0.150514 Aug 01 22:48:53.746673 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 327/674] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:53 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 1328 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:54.779467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:54.780150 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:54.787390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:54.787808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:54.788650 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:54.789157 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:54.803168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] HTTP exception thrown: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Request method failure captured: Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 HTTP/1.1 Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcJV5NhNUd6Y_Q3GPGdJwIr6vhnbvIp7utFIA43mQO1yywuPQZxtBd72C6kRfty0kSseoz_1vYe7pm_OwHvBpIHTL3MLP3PexSrIzgoxsQLMe6D7MRG7jBSHLAtJge1qSnuybajX2hF-QEo1cKc1OhAb4VkJuYDW7PeYYfHxwDpV3w Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:48:54.804845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dce176fe07434b6bbf6fa0c031c2903f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: e6d336332a65408c8a438c8f96f4415d Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:48:54.806479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '909f43f2-82b3-496f-8561-f7e7e385a275'} Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:48:54.807251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:48:54.808443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:48:54.809723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Returning 404 to user: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:48:54.809723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2c2ff24b-68fd-485d-b7b5-2c7712bf81ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 404 len: 111 microversion: 2.1 time: 0.031081 Aug 01 22:48:54.809723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 348/675] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:54 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 22:48:54.815226 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e2962709-af8c-46d8-8a30-85b54f9765ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '.version_select at 0x7fc541898ca0>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:54.836032 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e2962709-af8c-46d8-8a30-85b54f9765ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713754797" status: 202 len: 0 microversion: 2.1 time: 0.024588 Aug 01 22:48:54.836616 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 328/676] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 1 22:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713754797 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:48:55.482388 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cde225ea-b807-49e3-8cf0-bb4cf96f9b97 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'create', calling method: .version_select at 0x7fc5417f4310>, body: {"keypair": {"name": "tempest-keypair-1995332382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXkyqOkBhiJKR2Yx/BAFrHbdCOf7dyHGl9Zrl3otJlGCrzlWABE4efqGUqa0dwS2E/jYuvat2Pphh7aUx/ndZ9WEMLY6R41UKpDTi/Sq+FWnFEDjB3s0FRBEIZAnpHNeA=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:55.500403 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-cde225ea-b807-49e3-8cf0-bb4cf96f9b97 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:48:55.504822 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-cde225ea-b807-49e3-8cf0-bb4cf96f9b97 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for user e6d336332a65408c8a438c8f96f4415d and project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:48:55.535196 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cde225ea-b807-49e3-8cf0-bb4cf96f9b97 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060038 Aug 01 22:48:55.535796 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 349/677] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:48:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:48:56.869742 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-180254420", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67aba567-9102-406a-a1da-ceefe516bf22"}], "security_groups": [{"name": "tempest-securitygroup--1682180510"}], "key_name": "tempest-keypair-1995332382", "user_data": "}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:48:57.062723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] validate_networks() for [('67aba567-9102-406a-a1da-ceefe516bf22', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:48:57.957675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:48:57.958236 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:48:57.958588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:48:57.958990 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:48:57.959392 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:48:57.969009 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:57.969450 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:57.970263 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:57.970686 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:57.988230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:48:57.992367 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Getting quotas for user e6d336332a65408c8a438c8f96f4415d and project dce176fe07434b6bbf6fa0c031c2903f. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:48:58.004160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:48:58.006543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:48:58.053737 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0cde2f3a-5f31-4190-9983-3f252d613d6e tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.188859 Aug 01 22:48:58.060277 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 329/678] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:48:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:48:58.066278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c6b6a3a6-1f3f-40c0-8dea-971ca6776d04 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:58.067011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c6b6a3a6-1f3f-40c0-8dea-971ca6776d04 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:58.132181 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c6b6a3a6-1f3f-40c0-8dea-971ca6776d04 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:58.146218 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c6b6a3a6-1f3f-40c0-8dea-971ca6776d04 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1237 microversion: 2.1 time: 0.084126 Aug 01 22:48:58.158023 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 350/679] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:58 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:48:59.179346 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:48:59.180260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:48:59.188566 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:59.189125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:59.190005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:48:59.190528 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:48:59.267985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:48:59.279756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e6062bf8-ad36-4858-86cd-10a813601b18 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1297 microversion: 2.1 time: 0.103654 Aug 01 22:48:59.280842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 330/680] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:48:59 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:00.310596 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:00.312351 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:00.320054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:00.320583 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:00.321365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:00.322295 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:00.474569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:00.483406 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dcf64e4c-91dd-4093-9b71-5e5d10f6dd41 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1363 microversion: 2.1 time: 0.176790 Aug 01 22:49:00.483991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 351/681] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:00 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:00.645196 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-0319b375-2113-43b5-9f48-9839d90fa3ad req-d8e70ef6-4c5b-4016-bca3-2d48ce0e16d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986e9437-5bfc-4733-963c-b16eb7367ba8", "tag": "643075f3-1fd4-419a-aca1-77c5d6f07c76"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:00.656014 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-0319b375-2113-43b5-9f48-9839d90fa3ad req-d8e70ef6-4c5b-4016-bca3-2d48ce0e16d7 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:00.656446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-0319b375-2113-43b5-9f48-9839d90fa3ad req-d8e70ef6-4c5b-4016-bca3-2d48ce0e16d7 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:00.679959 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-0319b375-2113-43b5-9f48-9839d90fa3ad req-d8e70ef6-4c5b-4016-bca3-2d48ce0e16d7 service nova] Creating event network-changed:643075f3-1fd4-419a-aca1-77c5d6f07c76 for instance 986e9437-5bfc-4733-963c-b16eb7367ba8 on hv-cinder-85164 Aug 01 22:49:00.685084 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-0319b375-2113-43b5-9f48-9839d90fa3ad req-d8e70ef6-4c5b-4016-bca3-2d48ce0e16d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043530 Aug 01 22:49:00.685711 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 331/682] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:01.514451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:01.515065 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:01.522889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:01.523050 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:01.534330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:01.534919 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:01.690211 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:01.698222 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-835b3aaf-8d49-41ca-9b72-4fc598cd298f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1363 microversion: 2.1 time: 0.187858 Aug 01 22:49:01.698795 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 352/683] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:01 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:02.721187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:02.722159 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:02.729344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:02.729888 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:02.730792 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:02.731226 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:02.878130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:02.886046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-61f63b72-5453-46db-ba30-4eb0e5c8cd67 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1363 microversion: 2.1 time: 0.170290 Aug 01 22:49:02.886569 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 332/684] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:02 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:03.907336 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:03.907929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:03.911163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:03.919840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:03.920493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:03.921838 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:03.922597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:04.090975 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:04.101805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8f02aca9-92b3-4e77-9133-7609209f4fbe tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1363 microversion: 2.1 time: 0.198331 Aug 01 22:49:04.102612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 353/685] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:03 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:05.123652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:05.124561 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:05.126930 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:05.133290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:05.133772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:05.134599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:05.135033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:05.277943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:05.287728 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0ca71d04-3290-4f2d-8235-91dfe76b881c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1363 microversion: 2.1 time: 0.167998 Aug 01 22:49:05.288551 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 333/686] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:05 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:06.212978 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-6f7f3bbd-a4ef-4a07-ae90-389bfecbc9b6 req-30053d7a-bff8-470e-a4da-d5785d1d1eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986e9437-5bfc-4733-963c-b16eb7367ba8", "name": "network-vif-plugged", "status": "completed", "tag": "643075f3-1fd4-419a-aca1-77c5d6f07c76"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:06.224866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6f7f3bbd-a4ef-4a07-ae90-389bfecbc9b6 req-30053d7a-bff8-470e-a4da-d5785d1d1eab service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:06.225238 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6f7f3bbd-a4ef-4a07-ae90-389bfecbc9b6 req-30053d7a-bff8-470e-a4da-d5785d1d1eab service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:06.237123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-6f7f3bbd-a4ef-4a07-ae90-389bfecbc9b6 req-30053d7a-bff8-470e-a4da-d5785d1d1eab service nova] Creating event network-vif-plugged:643075f3-1fd4-419a-aca1-77c5d6f07c76 for instance 986e9437-5bfc-4733-963c-b16eb7367ba8 on hv-cinder-85164 Aug 01 22:49:06.242210 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-6f7f3bbd-a4ef-4a07-ae90-389bfecbc9b6 req-30053d7a-bff8-470e-a4da-d5785d1d1eab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245831 Aug 01 22:49:06.242786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 354/687] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:06.312471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:06.313780 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:06.321965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:06.322519 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:06.323353 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:06.323764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:06.515471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:06.524936 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5dc25ba7-c9dd-4a02-881c-36bc6569a904 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1363 microversion: 2.1 time: 0.216244 Aug 01 22:49:06.526253 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 334/688] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:06 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:07.547338 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:07.548111 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:07.555342 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:07.555794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:07.556672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:07.557110 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:07.741661 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:07.750474 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b974da61-aa54-43ac-b7e0-e8782ead0279 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1363 microversion: 2.1 time: 0.207862 Aug 01 22:49:07.751053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 355/689] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:07 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:08.773252 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:08.773988 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:08.776284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:08.776967 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:08.783578 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:08.784020 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:08.784998 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:08.785275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:08.925516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:08.933270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b76f97c7-ad5a-439a-a5cd-e8959dea3a02 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1549 microversion: 2.1 time: 0.165274 Aug 01 22:49:08.933888 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 335/690] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:08 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:08.954191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b613682d-e8e0-438c-88e1-853b96baea07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:08.954952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b613682d-e8e0-438c-88e1-853b96baea07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:08.956606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:08.963053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b613682d-e8e0-438c-88e1-853b96baea07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:08.963485 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b613682d-e8e0-438c-88e1-853b96baea07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:08.964324 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b613682d-e8e0-438c-88e1-853b96baea07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:08.964751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b613682d-e8e0-438c-88e1-853b96baea07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:09.047890 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b613682d-e8e0-438c-88e1-853b96baea07 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097567 Aug 01 22:49:09.048868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 356/691] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:49:08 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:10.101978 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-95f62d83-24a7-469e-9106-14fa6ade2af9 req-02821fac-ac66-46a7-8d29-309bf0b03bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986e9437-5bfc-4733-963c-b16eb7367ba8", "tag": "643075f3-1fd4-419a-aca1-77c5d6f07c76"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:10.114893 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-95f62d83-24a7-469e-9106-14fa6ade2af9 req-02821fac-ac66-46a7-8d29-309bf0b03bb8 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:10.116059 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-95f62d83-24a7-469e-9106-14fa6ade2af9 req-02821fac-ac66-46a7-8d29-309bf0b03bb8 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:10.128555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-95f62d83-24a7-469e-9106-14fa6ade2af9 req-02821fac-ac66-46a7-8d29-309bf0b03bb8 service nova] Creating event network-changed:643075f3-1fd4-419a-aca1-77c5d6f07c76 for instance 986e9437-5bfc-4733-963c-b16eb7367ba8 on hv-cinder-85164 Aug 01 22:49:10.134090 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-95f62d83-24a7-469e-9106-14fa6ade2af9 req-02821fac-ac66-46a7-8d29-309bf0b03bb8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036119 Aug 01 22:49:10.134981 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 336/692] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:19.804034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=7 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:19.804963 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:19.809781 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:19.810282 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:19.817969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:19.818415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:19.819196 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:19.819628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:19.916213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lazy-loading 'services' on Instance uuid 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:49:19.993617 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b87a9d4e-48e0-4cc1-9050-e5f77a6de220 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments/fdbbf76b-2a39-4dbd-945a-88be3464de83" status: 202 len: 0 microversion: 2.1 time: 0.191188 Aug 01 22:49:19.994350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 357/693] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:49:19 2022] DELETE /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments/fdbbf76b-2a39-4dbd-945a-88be3464de83 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:49:20.004757 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0ab1db06-7cc0-4193-83f9-2f7c37ad54af tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:20.007811 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0ab1db06-7cc0-4193-83f9-2f7c37ad54af tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:20.015507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ab1db06-7cc0-4193-83f9-2f7c37ad54af tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:20.016771 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ab1db06-7cc0-4193-83f9-2f7c37ad54af tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:20.017219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ab1db06-7cc0-4193-83f9-2f7c37ad54af tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:20.017690 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0ab1db06-7cc0-4193-83f9-2f7c37ad54af tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:20.053168 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0ab1db06-7cc0-4193-83f9-2f7c37ad54af tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054035 Aug 01 22:49:20.053793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 337/694] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:49:19 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:21.067401 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b23469a0-f730-42a5-982f-9d49d66f2352 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:21.069777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b23469a0-f730-42a5-982f-9d49d66f2352 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:21.077997 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b23469a0-f730-42a5-982f-9d49d66f2352 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:21.078387 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b23469a0-f730-42a5-982f-9d49d66f2352 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:21.079074 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b23469a0-f730-42a5-982f-9d49d66f2352 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:21.079509 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b23469a0-f730-42a5-982f-9d49d66f2352 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:21.119027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b23469a0-f730-42a5-982f-9d49d66f2352 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056498 Aug 01 22:49:21.119633 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 358/695] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:49:21 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:49:21.213653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:21.214336 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:21.225192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:21.225799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:21.227095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:21.227704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:21.233622 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=69 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:21.256580 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Going to try to terminate instance {{(pid=124356) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:49:21.342266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-65b9ec3f-2733-451c-8f5e-75c922371feb tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 204 len: 0 microversion: 2.1 time: 0.133667 Aug 01 22:49:21.343077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 338/696] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:49:21 2022] DELETE /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:49:21.352153 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:21.353367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:21.359303 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:21.359756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:21.360784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:21.361932 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:21.512318 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:21.522974 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1416b90b-47c4-47ba-a588-ee5d9565b89a tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1689 microversion: 2.1 time: 0.174714 Aug 01 22:49:21.523606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 359/697] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:21 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:22.556563 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:22.557374 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:22.564690 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:22.565133 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:22.565960 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:22.566387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:22.707377 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:22.715385 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bc85a71e-0584-45ce-8d72-a53d25f94d4d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1689 microversion: 2.1 time: 0.163020 Aug 01 22:49:22.715963 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 339/698] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:22 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:23.737840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:23.738463 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:23.745523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:23.746013 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:23.746782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:23.747209 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:23.895536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:23.903553 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1fead0c5-9025-4d47-8ee4-2fbdd2126c92 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1689 microversion: 2.1 time: 0.169765 Aug 01 22:49:23.904137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 360/699] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:23 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:24.929042 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:24.929845 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:24.936570 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:24.937143 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:24.938019 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:24.938550 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:25.122403 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:25.130523 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-49df2e77-45be-4642-adf5-bb7a6f0d0ae5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1689 microversion: 2.1 time: 0.205678 Aug 01 22:49:25.131113 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 340/700] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:24 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:26.155359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:26.156320 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:26.164809 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:26.165251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:26.166059 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:26.166487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:26.238479 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:26.251687 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-34e0b908-d575-4bfd-8b7c-e9edb34b5bc7 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 200 len: 1621 microversion: 2.1 time: 0.100009 Aug 01 22:49:26.252522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 361/701] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:26 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 1621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:26.398636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-1f8ca125-fe51-433e-9be8-537af09f79f4 req-0a511b08-5271-4e48-b175-f3703a1cb047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40608dc4-7e0c-4f8e-83cc-8f514e3ca783", "name": "network-vif-deleted", "tag": "cbe357ac-0ec9-4656-93e3-83c29a2e5708"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:26.412658 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-1f8ca125-fe51-433e-9be8-537af09f79f4 req-0a511b08-5271-4e48-b175-f3703a1cb047 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:26.413201 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-1f8ca125-fe51-433e-9be8-537af09f79f4 req-0a511b08-5271-4e48-b175-f3703a1cb047 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:26.429246 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-1f8ca125-fe51-433e-9be8-537af09f79f4 req-0a511b08-5271-4e48-b175-f3703a1cb047 service nova] Creating event network-vif-deleted:cbe357ac-0ec9-4656-93e3-83c29a2e5708 for instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 on hv-cinder-85164 Aug 01 22:49:26.435894 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-1f8ca125-fe51-433e-9be8-537af09f79f4 req-0a511b08-5271-4e48-b175-f3703a1cb047 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040917 Aug 01 22:49:26.436842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 341/702] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:27.274642 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:27.275224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: 40608dc4-7e0c-4f8e-83cc-8f514e3ca783] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:27.282920 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:27.283356 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:27.284123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:27.284735 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:27.300853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] HTTP exception thrown: Instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 could not be found. Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Request method failure captured: Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 HTTP/1.1 Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcFvf4aw_URmCUfiD67OVb-quybPOxELhtN9IfD7JvucjoqvMa7hcXurP0YYYB2IjO-LZ4mOypyLc0KDCM5Zw-dKimkoPzcfQWwHVRp6lWGSpEwbTlR4xmzyg1YDu_GrlBa30tR-aXXhWO97gf_LgUMmGqk-dNxSaBsn7DHf2A1kjI Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:49:27.302680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a6afb01194249d6af1c369e9f109b72", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: a8bbeb0e65a54b1199d0fe718168af70 Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 could not be found. Aug 01 22:49:27.304594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '40608dc4-7e0c-4f8e-83cc-8f514e3ca783'} Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 could not be found. Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:49:27.305590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 could not be found. Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 could not be found. Aug 01 22:49:27.306866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:49:27.308008 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Returning 404 to user: Instance 40608dc4-7e0c-4f8e-83cc-8f514e3ca783 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:49:27.308008 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-92e643ad-3518-4e95-bcec-31617e63dc35 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783" status: 404 len: 111 microversion: 2.1 time: 0.033535 Aug 01 22:49:27.308008 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 362/703] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:27 2022] GET /compute/v2.1/servers/40608dc4-7e0c-4f8e-83cc-8f514e3ca783 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 22:49:27.314593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7167a7eb-8b33-42cc-979e-c8b812da1f99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '.version_select at 0x7fc54184bca0>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:27.346441 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7167a7eb-8b33-42cc-979e-c8b812da1f99 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925472378" status: 202 len: 0 microversion: 2.1 time: 0.036151 Aug 01 22:49:27.346880 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 342/704] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 1 22:49:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925472378 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:49:30.332560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:30.333206 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:30.340423 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:30.340882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:30.341719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:30.342159 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:30.369623 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:49:30.455950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9e19f8ee-ebc9-40ab-b048-1307f553ed0e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 204 len: 0 microversion: 2.1 time: 0.127121 Aug 01 22:49:30.456683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 363/705] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:49:30 2022] DELETE /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:49:30.467963 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:30.468700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:30.476249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:30.476249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:30.476897 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:30.477395 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:30.633629 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:30.642144 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-280bbdf9-390f-448d-ae1e-4d19d500170c tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1508 microversion: 2.1 time: 0.180764 Aug 01 22:49:30.642726 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 343/706] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:30 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:31.665372 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:31.666085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:31.675647 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:31.676409 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:31.677815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:31.678738 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:31.861352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:31.869597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5c266e4e-1402-4dc4-af09-86f636bd1040 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1508 microversion: 2.1 time: 0.208556 Aug 01 22:49:31.870254 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 364/707] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:31 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:32.499354 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-6d363133-1cc5-4e22-8891-806626bb1f94 req-fd7a364b-d462-43f0-9b06-953bf75a7fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c6c53e-256e-456b-abfc-cc69f4edfa2d", "name": "network-vif-deleted", "tag": "5812ef14-fc5f-480a-9e1a-2c12b936b237"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:32.510777 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-6d363133-1cc5-4e22-8891-806626bb1f94 req-fd7a364b-d462-43f0-9b06-953bf75a7fae service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:32.511233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-6d363133-1cc5-4e22-8891-806626bb1f94 req-fd7a364b-d462-43f0-9b06-953bf75a7fae service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:32.524119 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-6d363133-1cc5-4e22-8891-806626bb1f94 req-fd7a364b-d462-43f0-9b06-953bf75a7fae service nova] Creating event network-vif-deleted:5812ef14-fc5f-480a-9e1a-2c12b936b237 for instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d on hv-cinder-85164 Aug 01 22:49:32.535770 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-6d363133-1cc5-4e22-8891-806626bb1f94 req-fd7a364b-d462-43f0-9b06-953bf75a7fae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040109 Aug 01 22:49:32.536395 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 344/708] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:49:32.892448 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:32.893124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:32.901073 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:32.901517 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:32.902639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:32.903076 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:32.939621 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:32.940251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:32.940522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lazy-loading 'fault' on Instance uuid d8c6c53e-256e-456b-abfc-cc69f4edfa2d {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:49:32.987353 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:32.996030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7888b8c1-4c9b-409d-ba91-c7d760037ce5 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 200 len: 1312 microversion: 2.1 time: 0.108425 Aug 01 22:49:32.996594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 365/709] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:32 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:34.018608 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:34.019331 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: d8c6c53e-256e-456b-abfc-cc69f4edfa2d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:34.026267 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:34.026711 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:34.027832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:34.028373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:34.042568 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] HTTP exception thrown: Instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d could not be found. Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Request method failure captured: Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d HTTP/1.1 Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcFvf4aw_URmCUfiD67OVb-quybPOxELhtN9IfD7JvucjoqvMa7hcXurP0YYYB2IjO-LZ4mOypyLc0KDCM5Zw-dKimkoPzcfQWwHVRp6lWGSpEwbTlR4xmzyg1YDu_GrlBa30tR-aXXhWO97gf_LgUMmGqk-dNxSaBsn7DHf2A1kjI Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:49:34.044396 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a6afb01194249d6af1c369e9f109b72", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: a8bbeb0e65a54b1199d0fe718168af70 Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d could not be found. Aug 01 22:49:34.046614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'd8c6c53e-256e-456b-abfc-cc69f4edfa2d'} Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d could not be found. Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:49:34.047645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d could not be found. Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d could not be found. Aug 01 22:49:34.049150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:34.050481 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Returning 404 to user: Instance d8c6c53e-256e-456b-abfc-cc69f4edfa2d could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:49:34.050481 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-73bd818d-21e8-49f9-b586-d659bfdb088e tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d" status: 404 len: 111 microversion: 2.1 time: 0.032002 Aug 01 22:49:34.050481 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 345/710] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:34 2022] GET /compute/v2.1/servers/d8c6c53e-256e-456b-abfc-cc69f4edfa2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:49:34.059412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:34.060312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:34.069941 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:34.070521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:34.071235 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:34.071645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:34.102462 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:49:34.189971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cfa1a42b-fd48-4b5c-b0af-a0de25fb22ba tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 204 len: 0 microversion: 2.1 time: 0.138176 Aug 01 22:49:34.190692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 366/711] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:49:34 2022] DELETE /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:49:34.199214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:34.200114 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:34.211436 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:34.211883 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:34.212672 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:34.213103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:34.360346 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:34.368791 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7c3f957b-6eb3-4301-9888-bb57648dddb6 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.173397 Aug 01 22:49:34.369373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 346/712] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:34 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:35.391246 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:35.391983 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:35.398983 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:35.399417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:35.400185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:35.400609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:35.565056 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:35.572899 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5a25a025-f2b0-40f8-80f3-711068ec1975 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.185920 Aug 01 22:49:35.573474 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 367/713] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:35 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:36.594732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:36.595360 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:36.597907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:36.607617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:36.608063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:36.608849 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:36.609276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:36.756184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:36.765124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2628ee8a-642a-417e-a433-920530a4e058 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1523 microversion: 2.1 time: 0.174711 Aug 01 22:49:36.765770 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 347/714] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:36 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:37.264439 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-16394eea-8133-4c4a-bffb-1bc90d645afd req-0dff8cb7-033f-4b26-a1dc-27928f6d80fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b370cbad-46b8-4418-9b13-b7158495237c", "name": "network-vif-deleted", "tag": "f8949b0e-8028-4226-9fec-5a9262634d95"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:37.275716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-16394eea-8133-4c4a-bffb-1bc90d645afd req-0dff8cb7-033f-4b26-a1dc-27928f6d80fa service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:37.276161 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-16394eea-8133-4c4a-bffb-1bc90d645afd req-0dff8cb7-033f-4b26-a1dc-27928f6d80fa service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:37.290014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-16394eea-8133-4c4a-bffb-1bc90d645afd req-0dff8cb7-033f-4b26-a1dc-27928f6d80fa service nova] Creating event network-vif-deleted:f8949b0e-8028-4226-9fec-5a9262634d95 for instance b370cbad-46b8-4418-9b13-b7158495237c on hv-cinder-85164 Aug 01 22:49:37.295689 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-16394eea-8133-4c4a-bffb-1bc90d645afd req-0dff8cb7-033f-4b26-a1dc-27928f6d80fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034852 Aug 01 22:49:37.296317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 368/715] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:37.360243 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d4721f3a-6bc7-4a39-80bb-a128c4feb14c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:37.361058 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d4721f3a-6bc7-4a39-80bb-a128c4feb14c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:37.371039 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d4721f3a-6bc7-4a39-80bb-a128c4feb14c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:37.371775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d4721f3a-6bc7-4a39-80bb-a128c4feb14c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:37.373130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d4721f3a-6bc7-4a39-80bb-a128c4feb14c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:37.373893 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d4721f3a-6bc7-4a39-80bb-a128c4feb14c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:37.401984 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d4721f3a-6bc7-4a39-80bb-a128c4feb14c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/ips" status: 200 len: 152 microversion: 2.20 time: 0.048263 Aug 01 22:49:37.402591 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 348/716] 10.222.0.47 () {60 vars in 1289 bytes} [Mon Aug 1 22:49:37 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 22:49:37.787757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:37.788857 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:37.798604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:37.799118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:37.799870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:37.800302 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:37.848371 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:37.849098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:37.849911 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lazy-loading 'fault' on Instance uuid b370cbad-46b8-4418-9b13-b7158495237c {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:49:37.908431 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8bbeb0e65a54b1199d0fe718168af70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6afb01194249d6af1c369e9f109b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:37.915521 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6eb56e9c-71fb-425b-aad4-f3116f4361a9 tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 200 len: 1312 microversion: 2.1 time: 0.132322 Aug 01 22:49:37.916099 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 369/717] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:37 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 1312 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:38.936920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:38.937715 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] [instance: b370cbad-46b8-4418-9b13-b7158495237c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:38.944822 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:38.945279 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:38.946096 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:38.946560 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:38.960735 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] HTTP exception thrown: Instance b370cbad-46b8-4418-9b13-b7158495237c could not be found. Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Request method failure captured: Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c HTTP/1.1 Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcFvf4aw_URmCUfiD67OVb-quybPOxELhtN9IfD7JvucjoqvMa7hcXurP0YYYB2IjO-LZ4mOypyLc0KDCM5Zw-dKimkoPzcfQWwHVRp6lWGSpEwbTlR4xmzyg1YDu_GrlBa30tR-aXXhWO97gf_LgUMmGqk-dNxSaBsn7DHf2A1kjI Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:49:38.962322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a6afb01194249d6af1c369e9f109b72", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a6afb01194249d6af1c369e9f109b72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 6a6afb01194249d6af1c369e9f109b72 Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1455825536 Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: a8bbeb0e65a54b1199d0fe718168af70 Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1455825536-project Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance b370cbad-46b8-4418-9b13-b7158495237c could not be found. Aug 01 22:49:38.963627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'b370cbad-46b8-4418-9b13-b7158495237c'} Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b370cbad-46b8-4418-9b13-b7158495237c could not be found. Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:49:38.964383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b370cbad-46b8-4418-9b13-b7158495237c could not be found. Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b370cbad-46b8-4418-9b13-b7158495237c could not be found. Aug 01 22:49:38.966375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:49:38.968392 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] Returning 404 to user: Instance b370cbad-46b8-4418-9b13-b7158495237c could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:49:38.968392 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3f9d46f6-bd88-4311-8d71-8ac2fe47773d tempest-ServerRescueNegativeTestJSON-1455825536 tempest-ServerRescueNegativeTestJSON-1455825536-project] 10.222.0.47 "GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c" status: 404 len: 111 microversion: 2.1 time: 0.030929 Aug 01 22:49:38.968392 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 349/718] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:38 2022] GET /compute/v2.1/servers/b370cbad-46b8-4418-9b13-b7158495237c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:49:39.177489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:39.178891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:39.186842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.187365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.188150 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.188607 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.193186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:39.199939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:39.200604 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:39.209505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.210820 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.211805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.212410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.215319 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lazy-loading 'flavor' on Instance uuid 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:49:39.240724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lazy-loading 'flavor' on Instance uuid b9d46d04-c425-4550-81d2-b81ae445092c {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:49:39.303705 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-60a834de-ab91-47c0-928d-0c06779fded5 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "POST /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8/action" status: 202 len: 0 microversion: 2.1 time: 0.129807 Aug 01 22:49:39.304577 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 370/719] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:49:39 2022] POST /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:49:39.318213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:39.319562 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:39.327339 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.328349 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.329226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.329677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.525084 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-cab86e78-2454-474b-8541-d472c4f5340f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/action" status: 202 len: 0 microversion: 2.20 time: 0.329287 Aug 01 22:49:39.525813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 350/720] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 1 22:49:39 2022] POST /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 22:49:39.536033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:39.536820 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:39.547525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.547973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.548935 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:39.549366 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:39.709703 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:39.720898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:39.722461 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:39.723932 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-626eb27b-7b65-4f15-901e-ce6596a0418a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.193058 Aug 01 22:49:39.724507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 351/721] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:39 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:49:39.877412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:39.887770 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c67af6ba-c950-4eae-a466-a008578412f0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.577607 Aug 01 22:49:39.888396 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 371/722] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:39 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:40.753599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:40.754608 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:40.766641 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:40.767172 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:40.767950 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:40.768383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:40.914083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:40.915141 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:40.927840 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:40.928847 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:40.929705 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:40.930139 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:40.931184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:40.946518 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:40.948769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:40.950286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bba9d046-8084-4eb4-bedc-802d1f8ad994 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.203044 Aug 01 22:49:40.965135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 352/723] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:40 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:41.158802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:41.166962 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f7c3684b-7991-4f97-aaa0-25bac9fbc031 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.256934 Aug 01 22:49:41.167585 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 372/724] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:40 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:41.988169 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:41.989160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:41.996220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:41.996682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:41.997466 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:41.997937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:42.196526 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:42.197581 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:42.215731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:42.216570 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:42.218005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:42.218783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:42.249605 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:42.265118 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:42.268793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:42.271593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2c20c8ac-5b49-4953-be0b-9e26ac1e561a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.287209 Aug 01 22:49:42.273314 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 353/725] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:41 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:42.424239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:42.441175 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-07e251a8-3601-4ba4-9101-67b9410132c8 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.255141 Aug 01 22:49:42.442337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 373/726] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:42 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:43.297480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:43.298562 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:43.307501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:43.308389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:43.309769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:43.310487 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:43.467042 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:43.468151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:43.477590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:43.478344 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:43.479157 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:43.479674 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:43.494568 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:43.503527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:43.505141 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:43.506512 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2ba839fe-583d-41c2-aa79-2ca57cb33a2a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.213181 Aug 01 22:49:43.522492 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 354/727] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:43 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:43.653695 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:43.661264 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-661d198f-2898-4ba3-ad3a-da4d26392ae1 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.200320 Aug 01 22:49:43.661864 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 374/728] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:43 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:44.535306 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:44.536018 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:44.542660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:44.543116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:44.544130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:44.544569 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:44.548740 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:44.689121 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:44.693724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:44.699211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:44.702725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:44.704591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:44.705915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:44.706574 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:44.708100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:44.709735 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:44.711075 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6c9043fe-1b05-4d71-996c-3fcc68692592 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.179796 Aug 01 22:49:44.726284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 355/729] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:44 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:44.919963 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:44.928022 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cdcb3c21-c5f7-48ba-b0ae-8a7e66db0574 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.248730 Aug 01 22:49:44.928542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 375/730] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:44 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:45.736314 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:45.736913 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:45.743904 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:45.744625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:45.745813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:45.746250 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:45.951609 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:45.956949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:45.956949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:45.965417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:45.965779 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:45.970801 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:45.971563 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:46.000593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:46.009938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:46.011522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ac7eb94a-d131-4477-84c2-67af400e9fab tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.279264 Aug 01 22:49:46.012376 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 356/731] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:45 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:46.285467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:46.293939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6de58389-95b8-48b5-98e7-38227ba9dec0 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.344166 Aug 01 22:49:46.294536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 376/732] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:45 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:47.046960 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:47.049148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:47.067816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:47.068286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:47.069237 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:47.069882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:47.249956 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:47.260382 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:47.262423 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:47.264154 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2c66a06e-55b7-457b-b92d-b12e70e3e758 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.222632 Aug 01 22:49:47.265207 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 357/733] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:47 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:47.327497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:47.329413 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:47.341776 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:47.342580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:47.343766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:47.344683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:47.657025 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:47.666386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ac3d180f-5bac-44fe-89e7-9234381cfe2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.345104 Aug 01 22:49:47.667088 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 377/734] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:47 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:48.288124 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:48.289286 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:48.296248 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:48.297093 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:48.298059 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:48.298643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:48.461896 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:48.472343 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:48.474077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:48.476652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6306a269-0196-429a-9a3c-d5f030c0f658 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.192467 Aug 01 22:49:48.477682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 358/735] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:48 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:48.697623 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:48.699549 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:48.706800 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:48.707431 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:48.708340 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:48.708995 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:48.980800 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:48.990191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f78dcb49-2ebb-49f8-9cef-5b7c3b8010bd tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.297817 Aug 01 22:49:48.991484 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 378/736] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:48 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:49.399496 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-02481458-ecae-4bde-9911-90abfa37912c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: .version_select at 0x7fc54184b790>, body: {"keypair": {"name": "tempest-keypair-2125996174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXO/r/WzpSSedscuQmxD2h2byKfG9RFZuQ9FZ4Jfs1f2pPkyRrEECgCD1nDzd1fXBNrrANngPKEkiyfpOcHJ8LxuvkQcHA2ymDPoqhFiehmeoknU2MknAOIYujtfHOHYA=="}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:49.417234 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-02481458-ecae-4bde-9911-90abfa37912c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:49:49.422134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-02481458-ecae-4bde-9911-90abfa37912c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:49:49.455655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-02481458-ecae-4bde-9911-90abfa37912c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185607 Aug 01 22:49:49.456278 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 359/737] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:49:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:49.500849 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:49.501442 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:49.507981 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:49.508410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:49.509368 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:49.510021 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:49.733827 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:49.746177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:49.748363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:49.750083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-73ed0efb-8d99-4d91-b860-d4492a0be5ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.253255 Aug 01 22:49:49.754947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 379/738] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:49 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:50.017637 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:50.018359 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:50.027477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:50.027918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:50.028710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:50.029603 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:50.523494 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:50.532567 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-13f9c5f1-2a84-480b-8e45-517854fb3ace tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.524258 Aug 01 22:49:50.551088 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 360/739] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:50 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:50.773857 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:50.775922 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:50.783430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:50.787088 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:50.788330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:50.789961 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:50.790961 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:51.063645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:51.073158 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:51.075073 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:51.077491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1c1585f6-7173-4cee-8fbb-2bc91e23b2cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.308259 Aug 01 22:49:51.079078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 380/740] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:50 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:51.257057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1015297922", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c13be76-3119-4964-bad8-1e95513c15ff"}], "security_groups": [{"name": "tempest-securitygroup--440541192"}], "key_name": "tempest-keypair-2125996174", "user_data": "}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:51.379614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] validate_networks() for [('8c13be76-3119-4964-bad8-1e95513c15ff', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:49:51.559117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:51.559725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:51.568252 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:51.569003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:51.569834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:51.570252 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:51.761746 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:51.772041 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6d0a257b-9832-4fa4-80ea-4dd0f8e67880 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.216743 Aug 01 22:49:51.772671 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 381/741] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:51 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:51.879802 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:49:51.880394 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:49:51.880789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:49:51.881218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:49:51.881737 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:49:51.891303 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:51.891754 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:51.892581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:51.893020 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:51.918644 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:49:51.924275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:49:51.941186 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:49:51.943577 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:49:52.033412 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-259806d1-9417-4aea-8b8d-c209474a615e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.781585 Aug 01 22:49:52.036290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 361/742] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:49:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:49:52.047853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a63d9f1c-8b93-4293-9a4c-e9d1824e0b8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:52.048530 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a63d9f1c-8b93-4293-9a4c-e9d1824e0b8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:52.107684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:52.108704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:52.119623 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a63d9f1c-8b93-4293-9a4c-e9d1824e0b8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:52.122617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:52.123742 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:52.125006 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:52.125766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:52.129409 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a63d9f1c-8b93-4293-9a4c-e9d1824e0b8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1242 microversion: 2.1 time: 0.084419 Aug 01 22:49:52.130074 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 382/743] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:52 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:52.328174 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:52.339233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:52.341058 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:52.342500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4b02502e-66ca-454d-a5ab-694c9afc8727 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.243805 Aug 01 22:49:52.343065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 362/744] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:52 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:52.807434 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:52.809017 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:52.819992 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:52.819992 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:52.819992 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:52.819992 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:53.043970 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:53.053626 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7fe2d9e3-d509-4629-862a-1604706cbf01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.258060 Aug 01 22:49:53.066114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 383/745] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:52 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:53.151370 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:53.152412 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:53.160391 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:53.161104 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:53.162157 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:53.162960 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:53.245185 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:53.253847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1cf4f70e-5377-46d9-bebe-339fba4a21cc tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1294 microversion: 2.1 time: 0.106728 Aug 01 22:49:53.254452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 363/746] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:53 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:53.369783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:53.370656 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:53.379839 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:53.380508 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:53.381663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:53.382419 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:53.560809 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:53.570567 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:53.572334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:53.573632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-27e37785-f802-47da-8d97-a8d3f1acb9fb tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.207948 Aug 01 22:49:53.574280 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 384/747] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:53 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:53.630173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a00756ee-d919-4fdf-83db-079b118d29a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:53.631250 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a00756ee-d919-4fdf-83db-079b118d29a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:53.638897 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a00756ee-d919-4fdf-83db-079b118d29a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:53.639653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a00756ee-d919-4fdf-83db-079b118d29a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:53.640430 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a00756ee-d919-4fdf-83db-079b118d29a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:53.641065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a00756ee-d919-4fdf-83db-079b118d29a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:53.666884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a00756ee-d919-4fdf-83db-079b118d29a1 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/ips" status: 200 len: 146 microversion: 2.1 time: 0.040983 Aug 01 22:49:53.667506 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 364/748] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:49:53 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:54.082946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:54.084802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:54.095495 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.096277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.097699 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.098438 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.249385 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:54.253196 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:54.258527 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-af803a0f-f449-4ec8-acc8-0cdc389d856a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1511 microversion: 2.1 time: 0.185638 Aug 01 22:49:54.259136 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 385/749] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:54 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:54.279416 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:54.280313 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:54.281604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:54.282376 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:54.287510 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.288312 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.289342 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.289832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.294022 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.294820 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.296192 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.296952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.357449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124358) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 22:49:54.365961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:54.374218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d6248f85-318d-409c-8ab6-e921cb234a26 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1300 microversion: 2.1 time: 0.099037 Aug 01 22:49:54.374813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 365/750] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:54 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:54.434689 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5b7e038d-9376-4f72-a5b9-82947f8a9e01 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "POST /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8/action" status: 202 len: 0 microversion: 2.1 time: 0.159067 Aug 01 22:49:54.435909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 386/751] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:49:54 2022] POST /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:49:54.444939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:54.446251 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:54.453021 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.453482 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.454419 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.455069 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.603725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:54.604554 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:54.613335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.614062 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.615078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:54.615667 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:54.637187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:54.649127 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9399fd6e-8037-455c-b2ee-b53b62597a05 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1519 microversion: 2.1 time: 0.208535 Aug 01 22:49:54.652703 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 366/752] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:54 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:54.852390 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:54.870241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:54.873977 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:54.876204 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bf48bd22-b760-4ebf-8440-57600680fa9b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.276073 Aug 01 22:49:54.894137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 387/753] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:54 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:49:55.093711 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a55ae96b-5319-4532-94b8-c9923b58dc50 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a3bf28-58c2-460a-9f4f-2b782ef7aef2"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:55.098242 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a55ae96b-5319-4532-94b8-c9923b58dc50 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:55.105033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55ae96b-5319-4532-94b8-c9923b58dc50 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.105482 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55ae96b-5319-4532-94b8-c9923b58dc50 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.106536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55ae96b-5319-4532-94b8-c9923b58dc50 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.106972 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55ae96b-5319-4532-94b8-c9923b58dc50 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.399984 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:55.400998 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:55.408274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.408719 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.409546 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.410146 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.444011 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a55ae96b-5319-4532-94b8-c9923b58dc50 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354678 Aug 01 22:49:55.449750 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 367/754] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:49:55 2022] POST /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:55.653509 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:55.672720 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9266236a-4524-4cac-80e8-d3a105ea0a4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1367 microversion: 2.1 time: 0.279750 Aug 01 22:49:55.674013 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 388/755] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:55 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:55.685403 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:55.689136 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:55.692222 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-62bc5554-189c-47df-8a4e-6073a5131e0c req-d19b6cd7-72d6-4847-9a21-d189876bb5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd51e566-5acc-4ac9-8cd0-b9b84e8657de", "tag": "9793b6b6-447d-4eba-8fe2-80ba086d406e"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:55.716203 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-62bc5554-189c-47df-8a4e-6073a5131e0c req-d19b6cd7-72d6-4847-9a21-d189876bb5b4 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.717280 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-62bc5554-189c-47df-8a4e-6073a5131e0c req-d19b6cd7-72d6-4847-9a21-d189876bb5b4 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.729402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.731653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.732514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.732973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.735367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-62bc5554-189c-47df-8a4e-6073a5131e0c req-d19b6cd7-72d6-4847-9a21-d189876bb5b4 service nova] Creating event network-changed:9793b6b6-447d-4eba-8fe2-80ba086d406e for instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de on hv-cinder-85164 Aug 01 22:49:55.742911 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-62bc5554-189c-47df-8a4e-6073a5131e0c req-d19b6cd7-72d6-4847-9a21-d189876bb5b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060375 Aug 01 22:49:55.743974 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 389/756] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:55.904590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:55.905697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:55.914261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.914829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:55.915663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:55.916135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:56.067537 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:56.087905 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:56.089110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-274be31a-a43b-4bd8-8337-45ccd15e80fc tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1521 microversion: 2.1 time: 0.416831 Aug 01 22:49:56.090164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 368/757] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:55 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:56.099564 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:56.102230 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:56.103715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7b16fc98-203f-495d-bc8e-6fd1d63f6446 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1744 microversion: 2.20 time: 0.205757 Aug 01 22:49:56.104671 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 390/758] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:55 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1744 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:56.696402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:56.697135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:56.704220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:56.704677 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:56.705469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:56.705933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:56.856249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:56.866226 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b7e4310a-aa60-4faf-9704-4a91c8d89515 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1367 microversion: 2.1 time: 0.173802 Aug 01 22:49:56.867133 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 369/759] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:56 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:57.112236 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:57.112832 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:57.120358 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:57.120805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:57.121685 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:57.122114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:57.128609 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:57.129219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:57.135653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:57.136105 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:57.137009 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:57.137443 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:57.261966 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:57.270875 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6868c12a-c649-40c5-a8b5-e088b0a71572 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1521 microversion: 2.1 time: 0.162541 Aug 01 22:49:57.271483 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 391/760] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:57 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:57.308959 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:57.318727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:57.320279 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:57.321967 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2dad9309-b790-4d7d-8f3c-4836cc69395d tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1744 microversion: 2.20 time: 0.196942 Aug 01 22:49:57.322627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 370/761] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:57 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:57.888037 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:57.888641 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:57.896480 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:57.896923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:57.897737 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:57.898157 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:58.042542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:58.050054 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5f24c7cf-fec3-41c5-bacd-adcc2bad85d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1367 microversion: 2.1 time: 0.166062 Aug 01 22:49:58.050609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 392/762] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:57 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:58.293539 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:58.294273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:58.302269 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:58.302890 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:58.303860 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:58.304340 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:58.350924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:58.351596 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:58.366672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:58.370081 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:58.372588 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:58.373093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:58.487808 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:58.496880 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-99efb223-4905-4b09-bc87-6d93061d36b2 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1521 microversion: 2.1 time: 0.207668 Aug 01 22:49:58.512035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 371/763] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:58 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:58.526995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-987a81da-b252-46ab-8b0c-5deb1c130d8c req-39fbbd4f-b3e4-436d-8adf-f063e357c230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d46d04-c425-4550-81d2-b81ae445092c", "name": "network-vif-plugged", "status": "completed", "tag": "8337104d-1ac5-46da-a5b2-bf7d7c573998"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:49:58.542220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-987a81da-b252-46ab-8b0c-5deb1c130d8c req-39fbbd4f-b3e4-436d-8adf-f063e357c230 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:58.543355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-987a81da-b252-46ab-8b0c-5deb1c130d8c req-39fbbd4f-b3e4-436d-8adf-f063e357c230 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:58.557013 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-987a81da-b252-46ab-8b0c-5deb1c130d8c req-39fbbd4f-b3e4-436d-8adf-f063e357c230 service nova] Creating event network-vif-plugged:8337104d-1ac5-46da-a5b2-bf7d7c573998 for instance b9d46d04-c425-4550-81d2-b81ae445092c on hv-cinder-85164 Aug 01 22:49:58.562806 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-987a81da-b252-46ab-8b0c-5deb1c130d8c req-39fbbd4f-b3e4-436d-8adf-f063e357c230 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048856 Aug 01 22:49:58.564345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 372/764] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:49:58.581968 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:58.600429 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:58.602345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:58.603520 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1790fd40-368d-4c49-a84c-e45c58c927cc tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.260345 Aug 01 22:49:58.614324 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 393/765] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:58 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:49:59.073299 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:59.074023 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:59.080882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:59.081327 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:59.082123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:59.082555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:59.085256 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:49:59.251011 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:59.263111 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4f4a9f64-023d-488e-a5ad-2127717b724c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1367 microversion: 2.1 time: 0.193978 Aug 01 22:49:59.263715 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 373/766] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:59 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:49:59.518322 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:59.519069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:59.528852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:59.529295 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:59.530231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:59.530657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:59.635315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:49:59.635910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:49:59.644368 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:59.645204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:59.646106 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:49:59.646780 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:49:59.706399 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:59.714261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c2150cf3-7fb4-48d5-8359-9c44ab7e79ee tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1521 microversion: 2.1 time: 0.199829 Aug 01 22:49:59.726151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 394/767] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:49:59 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:49:59.812751 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:59.839924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:59.841456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:49:59.842788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b4470a61-1935-4933-8b8a-57038e97ff25 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.211484 Aug 01 22:49:59.843389 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 374/768] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:49:59 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:00.292343 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:00.292987 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:00.303091 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:00.303842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:00.304841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:00.305492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:00.485364 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:00.495337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-176186cf-8ac6-4840-b6db-1abfb24f1cdd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1367 microversion: 2.1 time: 0.211979 Aug 01 22:50:00.496183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 395/769] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:00 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:00.581734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-9988f1b4-602d-4f9e-9a02-77b9291b781c req-dbf218c4-6907-459b-a90d-7eb0c65fe656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5b4fd5-f825-4c44-9be7-6e8139ae11b8", "name": "network-vif-unplugged", "status": "completed", "tag": "35b78388-fa60-4721-9b49-2f3ca747180d"}, {"server_uuid": "bd51e566-5acc-4ac9-8cd0-b9b84e8657de", "name": "network-vif-plugged", "status": "completed", "tag": "9793b6b6-447d-4eba-8fe2-80ba086d406e"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:00.594166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-9988f1b4-602d-4f9e-9a02-77b9291b781c req-dbf218c4-6907-459b-a90d-7eb0c65fe656 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:00.595241 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-9988f1b4-602d-4f9e-9a02-77b9291b781c req-dbf218c4-6907-459b-a90d-7eb0c65fe656 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:00.613946 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.compute.server_external_events [req-9988f1b4-602d-4f9e-9a02-77b9291b781c req-dbf218c4-6907-459b-a90d-7eb0c65fe656 service nova] Unable to find a host for instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8. Dropping event network-vif-unplugged {{(pid=124356) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 22:50:00.614801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-9988f1b4-602d-4f9e-9a02-77b9291b781c req-dbf218c4-6907-459b-a90d-7eb0c65fe656 service nova] Creating event network-vif-plugged:9793b6b6-447d-4eba-8fe2-80ba086d406e for instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de on hv-cinder-85164 Aug 01 22:50:00.620491 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-9988f1b4-602d-4f9e-9a02-77b9291b781c req-dbf218c4-6907-459b-a90d-7eb0c65fe656 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.042259 Aug 01 22:50:00.621424 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 375/770] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 22:50:00.741945 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:00.743644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:00.757213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:00.759017 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:00.760131 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:00.760565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:00.874726 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:00.875875 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:00.892861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:00.893850 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:00.894664 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:00.899078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:01.002197 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:01.012092 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eb0e6bfc-ecad-423b-899e-e31d0f766884 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1521 microversion: 2.1 time: 0.276679 Aug 01 22:50:01.021995 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 396/771] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:00 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:01.083750 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:01.097689 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:01.099301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:01.100524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3c08823b-e030-47e4-92f5-eac7e0437ce6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.232506 Aug 01 22:50:01.101082 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 376/772] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:00 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:50:01.523888 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:01.525021 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:01.534183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:01.534628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:01.535586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:01.538335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:01.752936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:01.772738 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bc1d6e84-ffb9-482c-8961-cf425aa83692 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1367 microversion: 2.1 time: 0.259197 Aug 01 22:50:01.774636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 397/773] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:01 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:02.036541 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:02.037478 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:02.043606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:02.043606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=10 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:02.050337 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:02.051110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:02.052033 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:02.052860 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:02.127700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:02.129174 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:02.135114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:02.147131 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:02.148082 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:02.149593 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:02.150239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:02.286165 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:02.308945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e7cdd3b5-21aa-4f12-ace3-63e44b7b934e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1521 microversion: 2.1 time: 0.276530 Aug 01 22:50:02.322723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 377/774] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:02 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:02.386425 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:02.395715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:02.397278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:02.398608 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-361d396a-6947-4c30-bb80-2748df45d2f9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.278251 Aug 01 22:50:02.399722 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 398/775] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:02 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:02.794935 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:02.795904 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:02.803173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:02.803862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:02.804782 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:02.805462 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.014999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:03.025134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5e39e2d4-aff5-433a-b885-9c73edaabb68 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1558 microversion: 2.1 time: 0.234007 Aug 01 22:50:03.025901 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 378/776] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:02 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:03.053956 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5ea599b0-2b40-4913-b19f-1d8cbea733bb tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:03.054757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5ea599b0-2b40-4913-b19f-1d8cbea733bb tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:03.065260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ea599b0-2b40-4913-b19f-1d8cbea733bb tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.065750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ea599b0-2b40-4913-b19f-1d8cbea733bb tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.066523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ea599b0-2b40-4913-b19f-1d8cbea733bb tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.067150 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ea599b0-2b40-4913-b19f-1d8cbea733bb tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.230665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5ea599b0-2b40-4913-b19f-1d8cbea733bb tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180299 Aug 01 22:50:03.239522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 399/777] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:50:03 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:03.330274 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:03.331052 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:03.345018 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.345544 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.346805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.347565 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.391041 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-54c85a6d-ea2f-4978-a0da-e515a4a46727 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:03.394552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-54c85a6d-ea2f-4978-a0da-e515a4a46727 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:03.402836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54c85a6d-ea2f-4978-a0da-e515a4a46727 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.403568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54c85a6d-ea2f-4978-a0da-e515a4a46727 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.404523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54c85a6d-ea2f-4978-a0da-e515a4a46727 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.405105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54c85a6d-ea2f-4978-a0da-e515a4a46727 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.463768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-54c85a6d-ea2f-4978-a0da-e515a4a46727 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079944 Aug 01 22:50:03.464882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 400/778] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:03 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:50:03.471105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:03.472058 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:03.479156 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.479835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.480940 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.481346 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.575169 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:03.592765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-620b0fd0-fa1f-48c6-89e9-299064cc0b8d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1521 microversion: 2.1 time: 0.263974 Aug 01 22:50:03.595406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 379/779] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:03 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:50:03.610441 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e0f03e78-959f-4d98-abf6-a1800699e36f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:03.620932 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e0f03e78-959f-4d98-abf6-a1800699e36f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:03.633323 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0f03e78-959f-4d98-abf6-a1800699e36f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.633807 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0f03e78-959f-4d98-abf6-a1800699e36f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.634586 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0f03e78-959f-4d98-abf6-a1800699e36f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:03.635024 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0f03e78-959f-4d98-abf6-a1800699e36f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:03.690682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e0f03e78-959f-4d98-abf6-a1800699e36f tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/e4a3bf28-58c2-460a-9f4f-2b782ef7aef2" status: 200 len: 194 microversion: 2.1 time: 0.093544 Aug 01 22:50:03.692265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 380/780] 10.222.0.47 () {58 vars in 1413 bytes} [Mon Aug 1 22:50:03 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/e4a3bf28-58c2-460a-9f4f-2b782ef7aef2 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:03.718491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:03.731183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:03.734377 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:03.736205 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2857f521-e972-485d-b8c0-a7e1c4e16fc6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.269778 Aug 01 22:50:03.737422 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 401/781] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:03 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:04.619421 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:04.620437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:04.627300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:04.627728 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:04.628710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:04.629462 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:04.765020 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:04.766324 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:04.773905 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:04.774666 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:04.775699 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:04.776333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:04.797571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:04.952917 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:04.966504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:04.968000 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:04.969358 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9d674703-dd50-4560-a438-08fd4dd444ba tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.208294 Aug 01 22:50:04.970641 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 402/782] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:04 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:05.195075 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:05.237585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2c86f2fa-786e-4cb2-9407-a17a4be75d2f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.623580 Aug 01 22:50:05.238418 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 381/783] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:04 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:05.296187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c18fdd66-bf76-420e-abf7-75b4c65a6358 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ba63985-ace3-42c4-9ca5-3ac376b6de32"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:05.298550 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c18fdd66-bf76-420e-abf7-75b4c65a6358 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:05.306768 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c18fdd66-bf76-420e-abf7-75b4c65a6358 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:05.307640 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c18fdd66-bf76-420e-abf7-75b4c65a6358 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:05.308987 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c18fdd66-bf76-420e-abf7-75b4c65a6358 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:05.310331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c18fdd66-bf76-420e-abf7-75b4c65a6358 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:05.538049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-6500b1bb-caeb-431d-84b4-85872b383eca req-e39a6cc8-c897-48cd-8572-939d8e9e61f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd51e566-5acc-4ac9-8cd0-b9b84e8657de", "tag": "9793b6b6-447d-4eba-8fe2-80ba086d406e"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:05.559059 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-6500b1bb-caeb-431d-84b4-85872b383eca req-e39a6cc8-c897-48cd-8572-939d8e9e61f3 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:05.559499 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-6500b1bb-caeb-431d-84b4-85872b383eca req-e39a6cc8-c897-48cd-8572-939d8e9e61f3 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:05.597734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-6500b1bb-caeb-431d-84b4-85872b383eca req-e39a6cc8-c897-48cd-8572-939d8e9e61f3 service nova] Creating event network-changed:9793b6b6-447d-4eba-8fe2-80ba086d406e for instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de on hv-cinder-85164 Aug 01 22:50:05.612112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-6500b1bb-caeb-431d-84b4-85872b383eca req-e39a6cc8-c897-48cd-8572-939d8e9e61f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076114 Aug 01 22:50:05.614572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 382/784] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:50:05.781417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c18fdd66-bf76-420e-abf7-75b4c65a6358 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "POST /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488895 Aug 01 22:50:05.782828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 403/785] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:50:05 2022] POST /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:06.002987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:06.004663 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:06.028317 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:06.029049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:06.033117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:06.033783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:06.266177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:06.267231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:06.282346 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:06.285879 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:06.288501 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:06.289187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:06.398154 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:06.417173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:06.419123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:06.420751 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ff5e7ea2-b92c-4914-bfbd-d39c0438669c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.424110 Aug 01 22:50:06.421895 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 383/786] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:05 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:06.581795 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:06.592077 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f029d88c-5d4e-43a8-927d-45fa74eaf645 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.331451 Aug 01 22:50:06.593327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 404/787] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:06 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:50:07.444977 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:07.446012 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:07.448988 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:07.459943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:07.460525 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:07.462260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:07.463332 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:07.618923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:07.619552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:07.626858 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:07.627755 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:07.628959 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:07.629670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:07.663020 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:07.678497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:07.680223 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:07.681654 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bb5afda6-94d7-47cd-a03e-e8217c45ad8c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.240963 Aug 01 22:50:07.693794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 384/788] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:07 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:50:07.815294 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:07.824492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e1cf92d9-b875-474f-a54a-7017bc0d221f tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.209543 Aug 01 22:50:07.825685 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 405/789] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:07 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:50:08.714470 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:08.715402 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:08.723501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:08.725290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:08.727236 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:08.729167 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:08.856743 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:08.857345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:08.863863 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:08.864497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:08.865447 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:08.866098 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:08.890158 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:08.898188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:08.899680 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:08.900840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-470428c9-cc4f-444b-812f-3da219d0c393 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1739 microversion: 2.20 time: 0.194151 Aug 01 22:50:08.901394 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 385/790] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:08 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:09.009380 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:09.017980 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8d940bbe-7b62-41da-8ff4-ea82cb784848 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.164924 Aug 01 22:50:09.018585 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 406/791] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:08 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:09.924234 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:09.924837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:09.932084 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:09.932462 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:09.933234 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:09.933708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:10.039578 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:10.040182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:10.046863 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:10.047311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:10.048079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:10.048514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:10.192801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:10.196076 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:10.202221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:10.203725 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:10.204891 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-cbdca5b4-d8ae-4276-9247-cc39e2292baf tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1721 microversion: 2.20 time: 0.284548 Aug 01 22:50:10.205635 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e2a2fc57-2427-4d3e-94ce-2c4515d64889 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.170094 Aug 01 22:50:10.205797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 386/792] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:09 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:10.206205 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 407/793] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:10 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:11.228354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:11.229828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:11.230879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:11.231995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:11.236566 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:11.237004 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:11.237900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:11.238502 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:11.242619 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:11.243323 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:11.244582 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:11.245249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:11.383649 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:11.391675 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:11.392340 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:11.393833 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:11.394992 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b62fa259-3fbe-42f8-91ae-44691f654404 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1721 microversion: 2.20 time: 0.170629 Aug 01 22:50:11.395561 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 408/794] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:11 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:11.402785 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-cff5bb0b-4b90-4efb-a814-931eeda6194a tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.178032 Aug 01 22:50:11.403358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 387/795] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:11 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:12.418806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:12.419665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:12.424673 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:12.425263 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:12.426537 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:12.426995 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:12.427786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:12.428207 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:12.432255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:12.432701 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:12.433588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:12.434014 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:12.579923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:12.587487 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:12.588415 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:12.590104 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:12.591280 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-34b5d4b1-24a7-4e6d-982d-e3136a94f7a6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1721 microversion: 2.20 time: 0.176542 Aug 01 22:50:12.591868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 409/796] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:12 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:50:12.596042 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0d7cf854-fd85-43ee-af47-5c1c02385267 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.175127 Aug 01 22:50:12.596616 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 388/797] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:12 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:13.617706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:13.618262 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:13.619299 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:13.619920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:13.624790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:13.625266 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:13.626064 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:13.626494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:13.626655 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:13.627086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:13.627861 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:13.628273 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:13.778422 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:13.780364 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:13.786467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a710496-85c8-46ab-b556-f400e0f18308 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.172783 Aug 01 22:50:13.787287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 410/798] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:13 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:13.788542 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:13.790096 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:13.791254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4218f8a5-e7e2-4b3a-8430-b137e3f86530 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1724 microversion: 2.20 time: 0.176252 Aug 01 22:50:13.791982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 389/799] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:13 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:13.813907 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-67bde015-aa66-4471-a42a-8fb0a9158608 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bb7fd3f-09d2-4192-894d-0a388bc3bd5a"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:13.816330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-67bde015-aa66-4471-a42a-8fb0a9158608 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:13.822668 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-67bde015-aa66-4471-a42a-8fb0a9158608 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:13.823110 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-67bde015-aa66-4471-a42a-8fb0a9158608 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:13.823922 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-67bde015-aa66-4471-a42a-8fb0a9158608 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:13.824351 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-67bde015-aa66-4471-a42a-8fb0a9158608 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.159261 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-67bde015-aa66-4471-a42a-8fb0a9158608 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.349219 Aug 01 22:50:14.159935 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 411/800] 10.222.0.47 () {62 vars in 1364 bytes} [Mon Aug 1 22:50:13 2022] POST /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 22:50:14.291044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-afe58040-de04-4ae2-a3fa-f36c7b0e6c61 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:14.291625 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-afe58040-de04-4ae2-a3fa-f36c7b0e6c61 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:14.298316 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe58040-de04-4ae2-a3fa-f36c7b0e6c61 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.299070 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe58040-de04-4ae2-a3fa-f36c7b0e6c61 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.299954 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe58040-de04-4ae2-a3fa-f36c7b0e6c61 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.300507 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-afe58040-de04-4ae2-a3fa-f36c7b0e6c61 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.309879 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-bb1c3981-cb46-4f05-bea5-94a15532ae74 req-ad8d3951-0efa-4421-8e27-e37ee0ee8e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d46d04-c425-4550-81d2-b81ae445092c", "name": "network-vif-unplugged", "status": "completed", "tag": "8337104d-1ac5-46da-a5b2-bf7d7c573998"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:14.322203 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bb1c3981-cb46-4f05-bea5-94a15532ae74 req-ad8d3951-0efa-4421-8e27-e37ee0ee8e8d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.322838 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bb1c3981-cb46-4f05-bea5-94a15532ae74 req-ad8d3951-0efa-4421-8e27-e37ee0ee8e8d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.335256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.compute.server_external_events [req-bb1c3981-cb46-4f05-bea5-94a15532ae74 req-ad8d3951-0efa-4421-8e27-e37ee0ee8e8d service nova] Unable to find a host for instance b9d46d04-c425-4550-81d2-b81ae445092c. Dropping event network-vif-unplugged {{(pid=124358) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 22:50:14.336142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-bb1c3981-cb46-4f05-bea5-94a15532ae74 req-ad8d3951-0efa-4421-8e27-e37ee0ee8e8d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030628 Aug 01 22:50:14.337159 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 412/801] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 22:50:14.395843 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=100 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:14.519646 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-44a56fd0-48c9-4d9a-b2bc-55159a5d0975 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:14.521798 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-44a56fd0-48c9-4d9a-b2bc-55159a5d0975 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:14.528576 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a56fd0-48c9-4d9a-b2bc-55159a5d0975 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.529047 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a56fd0-48c9-4d9a-b2bc-55159a5d0975 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.529851 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a56fd0-48c9-4d9a-b2bc-55159a5d0975 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.530278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a56fd0-48c9-4d9a-b2bc-55159a5d0975 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.559724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-afe58040-de04-4ae2-a3fa-f36c7b0e6c61 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-volume_attachments/0bb7fd3f-09d2-4192-894d-0a388bc3bd5a" status: 202 len: 0 microversion: 2.20 time: 0.272104 Aug 01 22:50:14.559724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 390/802] 10.222.0.47 () {60 vars in 1457 bytes} [Mon Aug 1 22:50:14 2022] DELETE /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-volume_attachments/0bb7fd3f-09d2-4192-894d-0a388bc3bd5a => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:50:14.561888 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-44a56fd0-48c9-4d9a-b2bc-55159a5d0975 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046149 Aug 01 22:50:14.562457 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 413/803] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:14 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:14.620382 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:14.621116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:14.628642 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.629095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.629969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.630408 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.660514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124356) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 22:50:14.710868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cb2e6c02-fd25-4b6e-92dd-e346b3c26e81 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:14.711732 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cb2e6c02-fd25-4b6e-92dd-e346b3c26e81 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:14.723724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb2e6c02-fd25-4b6e-92dd-e346b3c26e81 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.724449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb2e6c02-fd25-4b6e-92dd-e346b3c26e81 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.725701 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb2e6c02-fd25-4b6e-92dd-e346b3c26e81 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.726367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb2e6c02-fd25-4b6e-92dd-e346b3c26e81 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.747214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9394006c-46ef-45a2-9594-5da1b8080557 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "POST /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/action" status: 202 len: 0 microversion: 2.20 time: 0.130818 Aug 01 22:50:14.751542 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 391/804] 10.222.0.47 () {62 vars in 1319 bytes} [Mon Aug 1 22:50:14 2022] POST /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:50:14.757468 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:14.758261 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:14.765125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.765583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.766369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.766805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.779231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cb2e6c02-fd25-4b6e-92dd-e346b3c26e81 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/e4a3bf28-58c2-460a-9f4f-2b782ef7aef2" status: 200 len: 194 microversion: 2.1 time: 0.075837 Aug 01 22:50:14.779826 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 414/805] 10.222.0.47 () {58 vars in 1413 bytes} [Mon Aug 1 22:50:14 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/e4a3bf28-58c2-460a-9f4f-2b782ef7aef2 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:14.790108 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:14.790582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:14.800208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.800910 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.806013 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:14.807555 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:14.916160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:14.925724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lazy-loading 'services' on Instance uuid 986e9437-5bfc-4733-963c-b16eb7367ba8 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:50:15.008741 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:15.021410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-70aea6da-9373-4104-8cfb-e9d47ecf1503 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/e4a3bf28-58c2-460a-9f4f-2b782ef7aef2" status: 202 len: 0 microversion: 2.1 time: 0.235020 Aug 01 22:50:15.022455 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 415/806] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:50:14 2022] DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/e4a3bf28-58c2-460a-9f4f-2b782ef7aef2 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 22:50:15.029212 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:15.030938 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:15.040896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:15.046508 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:15.054953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:15.055227 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:15.056696 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:15.057424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:15.058918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2bcf20bd-c52d-484c-9cc9-9034df0ef127 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1672 microversion: 2.20 time: 0.304107 Aug 01 22:50:15.059575 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 392/807] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:14 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1672 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:15.243609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:15.252143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a37dcc94-0184-43f2-ab03-43104fd5c942 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.228485 Aug 01 22:50:15.253084 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 416/808] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:15 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:16.085364 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:16.086181 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:16.092911 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:16.093356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:16.094201 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:16.095297 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:16.258988 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:16.267786 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:16.269326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:16.270479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-887b215e-2ab6-4bb4-af5a-4564271a6413 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.189937 Aug 01 22:50:16.271216 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 393/809] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:16 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:50:16.278142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:16.278866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:16.286499 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:16.287269 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:16.288114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:16.288902 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:16.628029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:16.639763 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d300868c-4a69-4c3a-b360-3505671b4021 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.365035 Aug 01 22:50:16.654031 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 417/810] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:16 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:17.241522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-64465143-5473-4d8b-abe0-4c7fbec6bc33 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:17.242217 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-64465143-5473-4d8b-abe0-4c7fbec6bc33 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:17.248047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64465143-5473-4d8b-abe0-4c7fbec6bc33 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.248492 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64465143-5473-4d8b-abe0-4c7fbec6bc33 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.249495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64465143-5473-4d8b-abe0-4c7fbec6bc33 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.249955 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64465143-5473-4d8b-abe0-4c7fbec6bc33 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.281405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-64465143-5473-4d8b-abe0-4c7fbec6bc33 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/6ba63985-ace3-42c4-9ca5-3ac376b6de32" status: 200 len: 194 microversion: 2.1 time: 0.044165 Aug 01 22:50:17.283365 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 394/811] 10.222.0.47 () {58 vars in 1413 bytes} [Mon Aug 1 22:50:17 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/6ba63985-ace3-42c4-9ca5-3ac376b6de32 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:50:17.293464 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:17.294136 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:17.301129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.301594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.302437 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.302946 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.303984 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:17.304643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:17.311443 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.311944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.312722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.313176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.397135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lazy-loading 'services' on Instance uuid 986e9437-5bfc-4733-963c-b16eb7367ba8 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:50:17.476958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a15d04c3-4ed9-4340-b2f7-ecd4768976ea tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/6ba63985-ace3-42c4-9ca5-3ac376b6de32" status: 202 len: 0 microversion: 2.1 time: 0.187753 Aug 01 22:50:17.479228 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 418/812] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:50:17 2022] DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments/6ba63985-ace3-42c4-9ca5-3ac376b6de32 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:50:17.554053 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:17.562798 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:17.564387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:17.565651 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b651fb2f-4727-4973-a7cc-042743571423 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.268932 Aug 01 22:50:17.566230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 395/813] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:17 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:17.673298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:17.674018 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:17.680420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.680854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.681629 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:17.682058 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:17.831683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:17.840181 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bf99f986-2f6b-43bc-a947-9a53fb95f449 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.171434 Aug 01 22:50:17.840747 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 419/814] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:17 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:50:18.431056 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-7b32a144-8f4a-47de-93cc-445ce7ae5b38 req-a7e7589c-1cf5-4c04-af11-7cd53f37a15c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5b4fd5-f825-4c44-9be7-6e8139ae11b8", "name": "network-vif-plugged", "status": "completed", "tag": "35b78388-fa60-4721-9b49-2f3ca747180d"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:18.451473 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7b32a144-8f4a-47de-93cc-445ce7ae5b38 req-a7e7589c-1cf5-4c04-af11-7cd53f37a15c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:18.452351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7b32a144-8f4a-47de-93cc-445ce7ae5b38 req-a7e7589c-1cf5-4c04-af11-7cd53f37a15c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:18.466016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-7b32a144-8f4a-47de-93cc-445ce7ae5b38 req-a7e7589c-1cf5-4c04-af11-7cd53f37a15c service nova] Creating event network-vif-plugged:35b78388-fa60-4721-9b49-2f3ca747180d for instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 on hv-cinder-85164 Aug 01 22:50:18.474702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-7b32a144-8f4a-47de-93cc-445ce7ae5b38 req-a7e7589c-1cf5-4c04-af11-7cd53f37a15c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047459 Aug 01 22:50:18.475510 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 396/815] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:18.590187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:18.591645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:18.601805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:18.601805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:18.601805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:18.601805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:18.674800 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ffb66aaf-b5a5-473f-b7d1-5b98e6d6e56b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:18.677272 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ffb66aaf-b5a5-473f-b7d1-5b98e6d6e56b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:18.688585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ffb66aaf-b5a5-473f-b7d1-5b98e6d6e56b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:18.689889 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ffb66aaf-b5a5-473f-b7d1-5b98e6d6e56b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:18.691575 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ffb66aaf-b5a5-473f-b7d1-5b98e6d6e56b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:18.692289 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ffb66aaf-b5a5-473f-b7d1-5b98e6d6e56b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:18.740973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ffb66aaf-b5a5-473f-b7d1-5b98e6d6e56b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071286 Aug 01 22:50:18.741947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 397/816] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:18 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:18.770785 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:18.780249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:18.781893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:18.783299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4b081331-7710-4229-93cd-ce84a72123ff tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.197144 Aug 01 22:50:18.783913 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 420/817] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:18 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:18.863664 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:18.864288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:18.870839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:18.871264 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:18.872260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:18.872869 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:19.049163 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:19.058155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-56a5d169-dc92-46c2-9107-ae83b8179679 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.198480 Aug 01 22:50:19.058899 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 398/818] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:18 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:19.754320 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-58808822-5a84-4f33-acfa-485ac59f680a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:19.756799 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-58808822-5a84-4f33-acfa-485ac59f680a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:19.765944 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58808822-5a84-4f33-acfa-485ac59f680a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:19.766382 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58808822-5a84-4f33-acfa-485ac59f680a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:19.767168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58808822-5a84-4f33-acfa-485ac59f680a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:19.767903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58808822-5a84-4f33-acfa-485ac59f680a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:19.801425 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-58808822-5a84-4f33-acfa-485ac59f680a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051040 Aug 01 22:50:19.802027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 421/819] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:19 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:19.806835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:19.808452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:19.817202 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:19.817694 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:19.818516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:19.818952 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:20.013958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:20.024962 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:20.027074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:20.028464 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-09c139bb-39a5-4a78-a817-5516d4a3773b tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.226022 Aug 01 22:50:20.031682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 399/820] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:19 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:50:20.083011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:20.083886 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:20.090801 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:20.091300 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:20.093239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:20.093750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:20.260879 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:20.271059 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cf5fcdaa-203d-4bb4-94c2-891256d3bc65 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.191888 Aug 01 22:50:20.271642 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 422/821] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:20 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:20.815008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e0ea0f3a-8a94-4913-8b76-55133c524a69 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:20.817982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e0ea0f3a-8a94-4913-8b76-55133c524a69 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:20.826092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0ea0f3a-8a94-4913-8b76-55133c524a69 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:20.826551 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0ea0f3a-8a94-4913-8b76-55133c524a69 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:20.827345 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0ea0f3a-8a94-4913-8b76-55133c524a69 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:20.827783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e0ea0f3a-8a94-4913-8b76-55133c524a69 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:20.880833 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e0ea0f3a-8a94-4913-8b76-55133c524a69 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070400 Aug 01 22:50:20.882138 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 400/822] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:20 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:21.054567 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:21.055590 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:21.062458 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:21.064716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:21.065961 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:21.067027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:21.067728 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:21.225967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:21.236728 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:21.238378 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:21.239713 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b54d59fc-af7d-4be6-baea-4f03608cf019 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.189183 Aug 01 22:50:21.240341 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 423/823] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:21 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:50:21.294620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:21.295168 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:21.303373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:21.304229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:21.305173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:21.305801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:21.467072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:21.476746 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-29d0cb66-b800-41f0-9577-040751f4204e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.186212 Aug 01 22:50:21.477338 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 401/824] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:21 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:21.894050 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4e330524-9892-4031-aacf-0271979e4c5c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:21.896583 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4e330524-9892-4031-aacf-0271979e4c5c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:21.905066 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e330524-9892-4031-aacf-0271979e4c5c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:21.905736 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e330524-9892-4031-aacf-0271979e4c5c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:21.906737 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e330524-9892-4031-aacf-0271979e4c5c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:21.907317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4e330524-9892-4031-aacf-0271979e4c5c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:21.943602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4e330524-9892-4031-aacf-0271979e4c5c tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053623 Aug 01 22:50:21.944199 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 424/825] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:21 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:22.266656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:22.267285 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:22.278511 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:22.278959 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:22.279753 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:22.280191 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:22.453197 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:22.468029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:22.468736 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:22.470378 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c466ea62-7259-4daf-b244-7a2bc48c0403 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.207857 Aug 01 22:50:22.471020 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 402/826] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:22 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:22.498841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:22.500217 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:22.509235 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:22.509802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:22.510683 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:22.511299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:22.701065 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:22.709272 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dd765168-29a0-45a9-87b6-5730984c701d tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.214508 Aug 01 22:50:22.710112 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 425/827] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:22 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:22.958931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-64f899b1-64ab-4a71-916b-b5611b575282 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:22.961579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-64f899b1-64ab-4a71-916b-b5611b575282 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:22.969198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64f899b1-64ab-4a71-916b-b5611b575282 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:22.969666 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64f899b1-64ab-4a71-916b-b5611b575282 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:22.970925 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64f899b1-64ab-4a71-916b-b5611b575282 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:22.971461 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-64f899b1-64ab-4a71-916b-b5611b575282 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:23.016826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-64f899b1-64ab-4a71-916b-b5611b575282 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062328 Aug 01 22:50:23.017521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 403/828] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:22 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:23.497602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:23.498433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:23.507773 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:23.508750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:23.509177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:23.509730 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:23.676124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:23.689482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:23.691746 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:23.693937 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aba8966f-c1a7-4d02-8eca-8076bc65791e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.200440 Aug 01 22:50:23.694845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 426/829] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:23 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:23.731734 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:23.732476 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:23.741125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:23.741923 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:23.742702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:23.743133 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:24.030259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-280ac9f2-4c4c-4438-9f5d-43f994c9c798 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:24.032533 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-280ac9f2-4c4c-4438-9f5d-43f994c9c798 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:24.040495 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-280ac9f2-4c4c-4438-9f5d-43f994c9c798 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:24.041033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-280ac9f2-4c4c-4438-9f5d-43f994c9c798 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:24.041796 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-280ac9f2-4c4c-4438-9f5d-43f994c9c798 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:24.042379 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-280ac9f2-4c4c-4438-9f5d-43f994c9c798 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:24.089086 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-280ac9f2-4c4c-4438-9f5d-43f994c9c798 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064137 Aug 01 22:50:24.090305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 427/830] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:24 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:50:24.231710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:24.236677 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:24.257581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ba532c7d-4a8e-4b8b-8098-547bed734378 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.517722 Aug 01 22:50:24.261633 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 404/831] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:23 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:24.720152 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:24.720988 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:24.729055 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:24.729935 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:24.730734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:24.731331 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:24.888134 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:24.896688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:24.898304 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:24.899477 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-69ed70a0-f6a3-4701-88d1-d50e59ce4d10 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.183783 Aug 01 22:50:24.900232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 428/832] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:24 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:50:25.103910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-18189afe-d6b4-41a6-9021-c1daf4299be9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:25.107386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-18189afe-d6b4-41a6-9021-c1daf4299be9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:25.115652 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18189afe-d6b4-41a6-9021-c1daf4299be9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:25.116265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18189afe-d6b4-41a6-9021-c1daf4299be9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:25.117031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18189afe-d6b4-41a6-9021-c1daf4299be9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:25.117463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18189afe-d6b4-41a6-9021-c1daf4299be9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:25.154513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-18189afe-d6b4-41a6-9021-c1daf4299be9 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055902 Aug 01 22:50:25.157201 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 405/833] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:25 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:25.270774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:25.271751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:25.279043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:25.279546 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:25.280413 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:25.280991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:25.452586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:25.463226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-77cd530f-3d12-4683-b27a-fa11800056cf tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.197542 Aug 01 22:50:25.465668 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 429/834] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:25 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:25.923840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:25.925287 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:25.932142 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:25.932712 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:25.933827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:25.934236 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:26.117318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:26.126294 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:26.128134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:26.129394 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b4abe0ae-b08a-4bf9-a773-f79a2d3421be tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.209957 Aug 01 22:50:26.143081 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 406/835] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:25 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:26.168071 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f79e796a-1a68-4508-a072-e48751d32def tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:26.170893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f79e796a-1a68-4508-a072-e48751d32def tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:26.177795 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f79e796a-1a68-4508-a072-e48751d32def tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:26.178237 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f79e796a-1a68-4508-a072-e48751d32def tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:26.179062 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f79e796a-1a68-4508-a072-e48751d32def tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:26.179503 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f79e796a-1a68-4508-a072-e48751d32def tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:26.214102 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f79e796a-1a68-4508-a072-e48751d32def tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049920 Aug 01 22:50:26.214102 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 430/836] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:26 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:26.487160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:26.487881 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:26.494745 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:26.495762 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:26.497107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:26.497107 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:26.669390 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:26.674927 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3e34e020-cbc8-4e2e-97f9-f502c9489f75 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.192368 Aug 01 22:50:26.675737 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 407/837] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:26 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:50:27.154335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:27.155046 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:27.161940 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.162491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.163451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.163889 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.168420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:27.231727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ba94466b-cb00-4923-a126-1d336c587daa tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:27.235376 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ba94466b-cb00-4923-a126-1d336c587daa tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:27.247171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba94466b-cb00-4923-a126-1d336c587daa tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.247702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba94466b-cb00-4923-a126-1d336c587daa tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.250233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba94466b-cb00-4923-a126-1d336c587daa tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.250955 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ba94466b-cb00-4923-a126-1d336c587daa tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.290915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ba94466b-cb00-4923-a126-1d336c587daa tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066903 Aug 01 22:50:27.291406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 408/838] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:27 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 22:50:27.313748 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:27.328070 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:27.329675 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:27.330990 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c61938ac-1b36-4abd-9e35-d283a73090c9 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.180554 Aug 01 22:50:27.331514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 431/839] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:27 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:27.426198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-273306f2-9a54-4242-ace1-d91f709e0397 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:27.428397 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-273306f2-9a54-4242-ace1-d91f709e0397 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:27.435051 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-273306f2-9a54-4242-ace1-d91f709e0397 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.435511 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-273306f2-9a54-4242-ace1-d91f709e0397 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.436340 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-273306f2-9a54-4242-ace1-d91f709e0397 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.436777 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-273306f2-9a54-4242-ace1-d91f709e0397 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.467898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-273306f2-9a54-4242-ace1-d91f709e0397 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045649 Aug 01 22:50:27.468474 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 409/840] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:50:27 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:50:27.535144 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:27.535636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:27.542110 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.542519 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.543291 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.543725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.570787 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:50:27.666274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-01fb9f17-7a43-4468-886f-a8ded7fa2ed3 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 204 len: 0 microversion: 2.1 time: 0.134537 Aug 01 22:50:27.666898 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 432/841] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:50:27 2022] DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:50:27.676527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:27.677227 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:27.683907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.684416 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.685240 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.685720 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.701609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:27.702947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:27.715881 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.716347 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.717141 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:27.717591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:27.833073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:27.841387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-00a6dc48-47fd-4ab9-9fb8-83f22409fbb5 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1674 microversion: 2.1 time: 0.168692 Aug 01 22:50:27.842100 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 410/842] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:27 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:27.864192 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:27.875695 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4ed03cc2-d0d6-465b-bbe7-7f8ca3692f08 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.181172 Aug 01 22:50:27.876461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 433/843] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:27 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:28.355535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:28.356262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:28.363716 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:28.364066 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:28.364948 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:28.365378 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:28.516323 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:28.527433 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:28.529025 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:28.530291 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-956987cf-6e26-44f8-a835-c8d6aab0577f tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.178999 Aug 01 22:50:28.530869 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 411/844] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:28 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:28.868474 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:28.869508 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:28.880573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:28.881311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:28.882610 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:28.883317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:28.901000 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:28.901947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:28.908524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:28.908969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:28.909788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:28.910250 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:29.027499 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:29.035636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0f12f981-5448-4f3f-9467-9d5d7f4d163b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1674 microversion: 2.1 time: 0.173783 Aug 01 22:50:29.036367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 434/845] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:28 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:29.060458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:29.069014 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c8337e18-edd5-4e66-94f4-0a277ad71a91 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.172080 Aug 01 22:50:29.069677 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 412/846] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:28 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:29.555741 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:29.556474 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:29.563387 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:29.563872 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:29.564611 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:29.565078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:29.725152 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:29.734093 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:29.735570 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:29.736739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bbc8c011-6097-4b09-80be-9fc0705d572a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.186514 Aug 01 22:50:29.737297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 435/847] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:29 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:30.061230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:30.062413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:30.072368 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:30.073174 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:30.074606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:30.075310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:30.090645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:30.091376 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:30.098502 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:30.098950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:30.099718 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:30.100143 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:30.231249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:30.237278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:30.239852 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-cad4a381-8715-40c0-9784-5577bd872af8 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1674 microversion: 2.1 time: 0.185230 Aug 01 22:50:30.240680 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 413/848] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:30 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:30.246173 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-16f416c0-1866-4485-838a-4b0dbbfefeac tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.158932 Aug 01 22:50:30.247151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 436/849] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:30 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:50:30.760458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:30.761158 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:30.770412 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:30.771271 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:30.772982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:30.774135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:30.985103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:30.994683 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:30.996439 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:30.997660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7b5d8e20-0b8c-408b-b429-3139402bbaa1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.241087 Aug 01 22:50:30.998604 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 414/850] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:30 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:31.268335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:31.270257 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:31.273310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:31.275212 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:31.283316 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:31.283583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:31.283805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:31.284542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:31.285095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:31.285663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:31.286667 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:31.286802 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:31.398783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d336332a65408c8a438c8f96f4415d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce176fe07434b6bbf6fa0c031c2903f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:31.422692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-13e12fa6-ffd5-47db-92f4-a6194094922a tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 200 len: 1606 microversion: 2.1 time: 0.161779 Aug 01 22:50:31.423626 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 437/851] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:31 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 1606 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:31.447497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-af3886b2-732e-4186-b913-c27fc3632739 req-cb48a17c-eaac-45f8-9f94-534129988ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986e9437-5bfc-4733-963c-b16eb7367ba8", "name": "network-vif-deleted", "tag": "643075f3-1fd4-419a-aca1-77c5d6f07c76"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:31.459842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-af3886b2-732e-4186-b913-c27fc3632739 req-cb48a17c-eaac-45f8-9f94-534129988ed0 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:31.461094 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-af3886b2-732e-4186-b913-c27fc3632739 req-cb48a17c-eaac-45f8-9f94-534129988ed0 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:31.497653 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-af3886b2-732e-4186-b913-c27fc3632739 req-cb48a17c-eaac-45f8-9f94-534129988ed0 service nova] Creating event network-vif-deleted:643075f3-1fd4-419a-aca1-77c5d6f07c76 for instance 986e9437-5bfc-4733-963c-b16eb7367ba8 on hv-cinder-85164 Aug 01 22:50:31.504739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-af3886b2-732e-4186-b913-c27fc3632739 req-cb48a17c-eaac-45f8-9f94-534129988ed0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061420 Aug 01 22:50:31.507202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 438/852] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:31.610747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:31.634016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c66bb8d1-19b8-444b-88ef-c147bfed6077 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1577 microversion: 2.1 time: 0.364821 Aug 01 22:50:31.636113 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 415/853] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:31 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1577 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:32.039716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:32.040704 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:32.049029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:32.049695 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:32.050686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:32.051313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:32.203305 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:32.220804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:32.223824 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:32.226039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c8b3c5e9-b955-4e78-88ba-88f2a68143d0 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.196519 Aug 01 22:50:32.227216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 439/854] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:32 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:32.448407 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:32.449437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:32.457946 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:32.458746 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:32.459504 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:32.459915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:32.476110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] HTTP exception thrown: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Request method failure captured: Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 HTTP/1.1 Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcJV5NhNUd6Y_Q3GPGdJwIr6vhnbvIp7utFIA43mQO1yywuPQZxtBd72C6kRfty0kSseoz_1vYe7pm_OwHvBpIHTL3MLP3PexSrIzgoxsQLMe6D7MRG7jBSHLAtJge1qSnuybajX2hF-QEo1cKc1OhAb4VkJuYDW7PeYYfHxwDpV3w Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:50:32.477924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dce176fe07434b6bbf6fa0c031c2903f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: e6d336332a65408c8a438c8f96f4415d Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:32.479765 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '986e9437-5bfc-4733-963c-b16eb7367ba8'} Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:50:32.481235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:32.482772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:32.486953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Returning 404 to user: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:50:32.487939 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-41990e81-cb90-4082-b62f-653fb740ef0b tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 404 len: 111 microversion: 2.1 time: 0.044012 Aug 01 22:50:32.488888 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 416/855] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:32 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:50:32.497333 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ca3f6884-796d-4ad7-ac7f-a5df5e9fa8e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '.version_select at 0x7fc5418c9310>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:32.504580 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-1e4ccd83-4913-49a1-b15f-7562f7fcdde6 req-6c27dc86-76d4-4200-b646-ff3e5f7aaed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d46d04-c425-4550-81d2-b81ae445092c", "name": "network-vif-plugged", "status": "completed", "tag": "8337104d-1ac5-46da-a5b2-bf7d7c573998"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:32.522640 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ca3f6884-796d-4ad7-ac7f-a5df5e9fa8e0 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995332382" status: 202 len: 0 microversion: 2.1 time: 0.029191 Aug 01 22:50:32.523608 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-1e4ccd83-4913-49a1-b15f-7562f7fcdde6 req-6c27dc86-76d4-4200-b646-ff3e5f7aaed7 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:32.523762 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 440/856] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 1 22:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995332382 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:50:32.524441 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-1e4ccd83-4913-49a1-b15f-7562f7fcdde6 req-6c27dc86-76d4-4200-b646-ff3e5f7aaed7 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:32.545531 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-1e4ccd83-4913-49a1-b15f-7562f7fcdde6 req-6c27dc86-76d4-4200-b646-ff3e5f7aaed7 service nova] Creating event network-vif-plugged:8337104d-1ac5-46da-a5b2-bf7d7c573998 for instance b9d46d04-c425-4550-81d2-b81ae445092c on hv-cinder-85164 Aug 01 22:50:32.552505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-1e4ccd83-4913-49a1-b15f-7562f7fcdde6 req-6c27dc86-76d4-4200-b646-ff3e5f7aaed7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053083 Aug 01 22:50:32.554983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 417/857] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:50:32.657995 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:32.658991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:32.666703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:32.667187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:32.667986 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:32.668437 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:33.137903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:33.149255 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c4324615-cd46-4546-a905-9ad249142707 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1564 microversion: 2.1 time: 0.496041 Aug 01 22:50:33.150249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 441/858] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:32 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1564 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:50:33.273200 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:33.275558 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:33.285161 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:33.285966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:33.287282 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:33.288005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:33.460925 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:33.472926 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:33.474698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:33.475906 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-45d26f06-7358-4c96-978c-1a8bf83bf8a4 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.213851 Aug 01 22:50:33.476505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 418/859] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:33 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:34.501843 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:34.502660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:34.512163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:34.512869 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:34.513682 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:34.514172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:34.752693 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:34.767897 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:34.770092 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:34.772033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-68f9117c-cf41-49f3-8645-e25d51190f42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1730 microversion: 2.20 time: 0.275253 Aug 01 22:50:34.772548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 442/860] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:34 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1730 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:35.750140 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:35.750906 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:35.757719 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:35.758176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:35.758981 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:35.759465 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:35.773293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] HTTP exception thrown: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Request method failure captured: Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 HTTP/1.1 Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcJV5NhNUd6Y_Q3GPGdJwIr6vhnbvIp7utFIA43mQO1yywuPQZxtBd72C6kRfty0kSseoz_1vYe7pm_OwHvBpIHTL3MLP3PexSrIzgoxsQLMe6D7MRG7jBSHLAtJge1qSnuybajX2hF-QEo1cKc1OhAb4VkJuYDW7PeYYfHxwDpV3w Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:50:35.775022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dce176fe07434b6bbf6fa0c031c2903f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: e6d336332a65408c8a438c8f96f4415d Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.776614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '986e9437-5bfc-4733-963c-b16eb7367ba8'} Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:50:35.777435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.778892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.780233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Returning 404 to user: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:50:35.780233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d3a5bec7-5b45-4b77-a90b-03af9b7f13b2 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 404 len: 111 microversion: 2.1 time: 0.030525 Aug 01 22:50:35.780233 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 419/861] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:50:35 2022] DELETE /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:50:35.786429 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:35.787272 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 986e9437-5bfc-4733-963c-b16eb7367ba8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:35.798277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:35.798277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:35.798277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:35.799826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:35.799971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:35.801474 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:35.805601 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:35.806126 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:35.806946 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:35.807366 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:35.812124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] HTTP exception thrown: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Request method failure captured: Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 HTTP/1.1 Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcJV5NhNUd6Y_Q3GPGdJwIr6vhnbvIp7utFIA43mQO1yywuPQZxtBd72C6kRfty0kSseoz_1vYe7pm_OwHvBpIHTL3MLP3PexSrIzgoxsQLMe6D7MRG7jBSHLAtJge1qSnuybajX2hF-QEo1cKc1OhAb4VkJuYDW7PeYYfHxwDpV3w Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:50:35.813825 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dce176fe07434b6bbf6fa0c031c2903f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: e6d336332a65408c8a438c8f96f4415d Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.816663 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '986e9437-5bfc-4733-963c-b16eb7367ba8'} Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:50:35.818350 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. Aug 01 22:50:35.820947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:35.823919 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Returning 404 to user: Instance 986e9437-5bfc-4733-963c-b16eb7367ba8 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:50:35.823919 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a5908a2c-c445-4a58-a94c-427b04fb5d95 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8" status: 404 len: 111 microversion: 2.1 time: 0.032920 Aug 01 22:50:35.823919 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 443/862] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:35 2022] GET /compute/v2.1/servers/986e9437-5bfc-4733-963c-b16eb7367ba8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:50:35.976056 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:35.985199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:35.986789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:50:35.987954 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-fb9c655f-c38a-4ff0-af7b-d734b7487e42 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1717 microversion: 2.20 time: 0.193849 Aug 01 22:50:35.988518 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 420/863] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:50:35 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:50:36.985992 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:36.986628 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:36.993269 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:36.993774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:36.994549 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:36.994988 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:37.018202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] HTTP exception thrown: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Request method failure captured: Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 HTTP/1.1 Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcJV5NhNUd6Y_Q3GPGdJwIr6vhnbvIp7utFIA43mQO1yywuPQZxtBd72C6kRfty0kSseoz_1vYe7pm_OwHvBpIHTL3MLP3PexSrIzgoxsQLMe6D7MRG7jBSHLAtJge1qSnuybajX2hF-QEo1cKc1OhAb4VkJuYDW7PeYYfHxwDpV3w Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:50:37.019926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dce176fe07434b6bbf6fa0c031c2903f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: e6d336332a65408c8a438c8f96f4415d Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.021516 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '909f43f2-82b3-496f-8561-f7e7e385a275'} Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:50:37.022435 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.027051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.028734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Returning 404 to user: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:50:37.028734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-de6977f7-967c-4348-8cb4-d7380c7466ae tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "DELETE /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 404 len: 111 microversion: 2.1 time: 0.040026 Aug 01 22:50:37.028734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 444/864] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:50:36 2022] DELETE /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:50:37.031653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:37.032265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] [instance: 909f43f2-82b3-496f-8561-f7e7e385a275] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:37.039007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:37.039449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:37.040203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:37.040634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:37.054296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] HTTP exception thrown: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Request method failure captured: Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 HTTP/1.1 Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcJV5NhNUd6Y_Q3GPGdJwIr6vhnbvIp7utFIA43mQO1yywuPQZxtBd72C6kRfty0kSseoz_1vYe7pm_OwHvBpIHTL3MLP3PexSrIzgoxsQLMe6D7MRG7jBSHLAtJge1qSnuybajX2hF-QEo1cKc1OhAb4VkJuYDW7PeYYfHxwDpV3w Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:50:37.055809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dce176fe07434b6bbf6fa0c031c2903f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dce176fe07434b6bbf6fa0c031c2903f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: dce176fe07434b6bbf6fa0c031c2903f Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270908099 Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: e6d336332a65408c8a438c8f96f4415d Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeTestJSON-270908099-project Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.057329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '909f43f2-82b3-496f-8561-f7e7e385a275'} Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:50:37.058676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. Aug 01 22:50:37.060073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:50:37.061329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] Returning 404 to user: Instance 909f43f2-82b3-496f-8561-f7e7e385a275 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:50:37.061329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d0cda87f-7a02-4cd3-9d7d-d580b25fc954 tempest-AttachVolumeTestJSON-270908099 tempest-AttachVolumeTestJSON-270908099-project] 10.222.0.47 "GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275" status: 404 len: 111 microversion: 2.1 time: 0.029332 Aug 01 22:50:37.061329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 421/865] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:50:37 2022] GET /compute/v2.1/servers/909f43f2-82b3-496f-8561-f7e7e385a275 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:50:49.869928 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ad41b124-bf29-4e66-8b3b-ff06c0c5e7d5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:50:49.870495 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ad41b124-bf29-4e66-8b3b-ff06c0c5e7d5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:49.872820 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:49.874244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:49.887316 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad41b124-bf29-4e66-8b3b-ff06c0c5e7d5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:49.887951 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad41b124-bf29-4e66-8b3b-ff06c0c5e7d5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:49.888729 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad41b124-bf29-4e66-8b3b-ff06c0c5e7d5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:49.889154 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad41b124-bf29-4e66-8b3b-ff06c0c5e7d5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:49.917743 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ad41b124-bf29-4e66-8b3b-ff06c0c5e7d5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/ips" status: 200 len: 150 microversion: 2.1 time: 0.052068 Aug 01 22:50:49.918580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 445/866] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:50:49 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:51.432425 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-aa318c02-28c3-447d-9b68-63590d733cfe tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2630ade0-c19b-4085-88b8-e3def5cb8515"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:51.436486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-aa318c02-28c3-447d-9b68-63590d733cfe tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:50:51.441691 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:51.442756 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=86 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:50:51.451999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa318c02-28c3-447d-9b68-63590d733cfe tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:51.452667 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa318c02-28c3-447d-9b68-63590d733cfe tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:51.454080 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa318c02-28c3-447d-9b68-63590d733cfe tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:50:51.454839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa318c02-28c3-447d-9b68-63590d733cfe tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:50:51.756961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-aa318c02-28c3-447d-9b68-63590d733cfe tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332157 Aug 01 22:50:51.757868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 422/867] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:50:51 2022] POST /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:50:59.379697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f285f031-e0a5-4c75-a05b-de2ea1865a01 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: .version_select at 0x7fc5419174c0>, body: {"keypair": {"name": "tempest-keypair-1460697804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzXAiqVfRivxuVq9yCzMcv6ut1ht7BXvn0H8xpQPj+cXhb4RjGvRQe+/yeoeuUQYveucW3gzvjfq2lSo6GHVZTmo1RPzzKqUUiP+PYVbDih4159e/Jt3bfIZ9/Z5nXgSA=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:50:59.397151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-f285f031-e0a5-4c75-a05b-de2ea1865a01 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:50:59.401314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-f285f031-e0a5-4c75-a05b-de2ea1865a01 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:50:59.425948 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f285f031-e0a5-4c75-a05b-de2ea1865a01 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050237 Aug 01 22:50:59.426550 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 446/868] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:50:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:00.804550 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1122057954", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c13be76-3119-4964-bad8-1e95513c15ff"}], "security_groups": [{"name": "tempest-securitygroup--889547709"}], "key_name": "tempest-keypair-1460697804", "user_data": "}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:00.914722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] validate_networks() for [('8c13be76-3119-4964-bad8-1e95513c15ff', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:51:01.301688 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:51:01.302118 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:51:01.302589 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:51:01.303020 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:51:01.303571 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:51:01.312976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:01.313434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:01.314260 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:01.314695 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:01.331888 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:51:01.335980 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:51:01.347663 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:51:01.350090 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:51:01.397962 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f3d75840-d6ec-481e-b792-722b5427b631 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.598560 Aug 01 22:51:01.398848 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 423/869] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:51:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:51:01.406564 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=4 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:01.411178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-909414f2-d7f4-4930-bfe2-e5292ea768c3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:01.411815 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-909414f2-d7f4-4930-bfe2-e5292ea768c3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:01.467189 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-909414f2-d7f4-4930-bfe2-e5292ea768c3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:01.474989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-909414f2-d7f4-4930-bfe2-e5292ea768c3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1242 microversion: 2.1 time: 0.068960 Aug 01 22:51:01.475312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 447/870] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:01 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:02.501570 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:02.502390 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:02.516422 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:02.517200 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:02.518399 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:02.518940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:02.608728 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:02.616803 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-69dcd614-db8d-4dfb-a831-937ebf33427b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1302 microversion: 2.1 time: 0.121917 Aug 01 22:51:02.630958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 424/871] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:02 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1302 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:03.640398 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:03.641073 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:03.648572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:03.649458 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:03.650286 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:03.650716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:03.822716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:03.834187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0d4ebb91-6cf6-4e40-83a9-c0a683a98dec tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1367 microversion: 2.1 time: 0.198643 Aug 01 22:51:03.834882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 448/872] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:03 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:51:04.136564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-f4a500b6-048c-405d-9021-03ede71b54fd req-33d997da-b9f5-4770-9665-bb208c273d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac705013-d650-48da-afca-8b68f18ca0fd", "tag": "a330fe48-42e4-4fa4-a7ad-44efaa22e7f2"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:04.158842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f4a500b6-048c-405d-9021-03ede71b54fd req-33d997da-b9f5-4770-9665-bb208c273d87 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:04.159514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f4a500b6-048c-405d-9021-03ede71b54fd req-33d997da-b9f5-4770-9665-bb208c273d87 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:04.174488 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-f4a500b6-048c-405d-9021-03ede71b54fd req-33d997da-b9f5-4770-9665-bb208c273d87 service nova] Creating event network-changed:a330fe48-42e4-4fa4-a7ad-44efaa22e7f2 for instance ac705013-d650-48da-afca-8b68f18ca0fd on hv-cinder-85164 Aug 01 22:51:04.179957 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-f4a500b6-048c-405d-9021-03ede71b54fd req-33d997da-b9f5-4770-9665-bb208c273d87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050934 Aug 01 22:51:04.180440 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 425/873] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:04.863616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:04.864202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:04.871999 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:04.872454 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:04.873236 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:04.873696 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:05.044067 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:05.051906 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-27989f9c-7d67-40fd-ad8c-376e5fc521c1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1367 microversion: 2.1 time: 0.192467 Aug 01 22:51:05.052475 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 449/874] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:04 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:06.082827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:06.083742 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:06.091287 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:06.091722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:06.092486 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:06.092923 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:06.326769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:06.335920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6e8589e5-f949-4bab-aab2-cf7d2a7bdbd0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1367 microversion: 2.1 time: 0.258172 Aug 01 22:51:06.336512 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 426/875] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:06 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:07.361704 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:07.363004 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:07.371780 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:07.372224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:07.373015 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:07.373451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:07.554332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:07.565805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-647bc404-6cfb-42ad-b63c-0298cfb03c34 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1367 microversion: 2.1 time: 0.208797 Aug 01 22:51:07.566562 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 450/876] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:07 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:08.587582 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:08.588266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:08.597129 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:08.597905 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:08.598902 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:08.599378 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:08.799388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:08.812094 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e25053df-6446-4557-8b53-ecd5e964dc8b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1367 microversion: 2.1 time: 0.226879 Aug 01 22:51:08.812094 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 427/877] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:08 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:09.840701 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:09.841505 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:09.849489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:09.850188 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:09.851557 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:09.852345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:09.909736 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-354a21ac-3a8b-41ce-b668-114670cb5bf1 req-81deec8c-6ac4-4c02-852b-374695e3315a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac705013-d650-48da-afca-8b68f18ca0fd", "name": "network-vif-plugged", "status": "completed", "tag": "a330fe48-42e4-4fa4-a7ad-44efaa22e7f2"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:09.922928 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-354a21ac-3a8b-41ce-b668-114670cb5bf1 req-81deec8c-6ac4-4c02-852b-374695e3315a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:09.923612 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-354a21ac-3a8b-41ce-b668-114670cb5bf1 req-81deec8c-6ac4-4c02-852b-374695e3315a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:09.938722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-354a21ac-3a8b-41ce-b668-114670cb5bf1 req-81deec8c-6ac4-4c02-852b-374695e3315a service nova] Creating event network-vif-plugged:a330fe48-42e4-4fa4-a7ad-44efaa22e7f2 for instance ac705013-d650-48da-afca-8b68f18ca0fd on hv-cinder-85164 Aug 01 22:51:09.944181 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-354a21ac-3a8b-41ce-b668-114670cb5bf1 req-81deec8c-6ac4-4c02-852b-374695e3315a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038712 Aug 01 22:51:09.945489 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 428/878] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:10.045115 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:10.055907 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f84a14c2-95e8-4ccd-be93-e7447bd7f78a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1367 microversion: 2.1 time: 0.220233 Aug 01 22:51:10.056668 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 451/879] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:09 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:11.083554 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:11.084827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:11.097158 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:11.097998 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:11.099410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:11.100199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:11.277080 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:11.287500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9565f4b8-c940-40e1-9933-1ed3aff3c992 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1367 microversion: 2.1 time: 0.212541 Aug 01 22:51:11.288211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 429/880] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:11 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:12.312688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:12.317155 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:12.317993 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:12.324771 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:12.325226 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:12.326075 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:12.326512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:12.510841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:12.520615 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e140f6c4-dab5-4579-982d-da0e2cfbad23 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1558 microversion: 2.1 time: 0.209585 Aug 01 22:51:12.521208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 452/881] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:12 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:12.544333 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c9805255-e940-4fa5-9bb0-92a7a0170c77 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:12.544333 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c9805255-e940-4fa5-9bb0-92a7a0170c77 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:12.547952 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:12.549266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:12.555774 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c9805255-e940-4fa5-9bb0-92a7a0170c77 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:12.556343 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c9805255-e940-4fa5-9bb0-92a7a0170c77 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:12.557521 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c9805255-e940-4fa5-9bb0-92a7a0170c77 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:12.558078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c9805255-e940-4fa5-9bb0-92a7a0170c77 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:12.654556 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c9805255-e940-4fa5-9bb0-92a7a0170c77 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115112 Aug 01 22:51:12.655301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 430/882] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:51:12 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:13.829184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-4aa1e1aa-8a89-4e19-8f5a-d07fb428264a req-4484ab3d-fda5-40e6-971a-d23d9fb0e8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac705013-d650-48da-afca-8b68f18ca0fd", "tag": "a330fe48-42e4-4fa4-a7ad-44efaa22e7f2"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:13.841687 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-4aa1e1aa-8a89-4e19-8f5a-d07fb428264a req-4484ab3d-fda5-40e6-971a-d23d9fb0e8b8 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:13.842278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-4aa1e1aa-8a89-4e19-8f5a-d07fb428264a req-4484ab3d-fda5-40e6-971a-d23d9fb0e8b8 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:13.855033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-4aa1e1aa-8a89-4e19-8f5a-d07fb428264a req-4484ab3d-fda5-40e6-971a-d23d9fb0e8b8 service nova] Creating event network-changed:a330fe48-42e4-4fa4-a7ad-44efaa22e7f2 for instance ac705013-d650-48da-afca-8b68f18ca0fd on hv-cinder-85164 Aug 01 22:51:13.861014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-4aa1e1aa-8a89-4e19-8f5a-d07fb428264a req-4484ab3d-fda5-40e6-971a-d23d9fb0e8b8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036078 Aug 01 22:51:13.861933 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 453/883] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:17.100767 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4e717ffa-95d7-4e88-b3dc-cca2094beb8a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:17.103117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4e717ffa-95d7-4e88-b3dc-cca2094beb8a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:17.110628 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e717ffa-95d7-4e88-b3dc-cca2094beb8a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:17.111693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e717ffa-95d7-4e88-b3dc-cca2094beb8a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:17.112505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e717ffa-95d7-4e88-b3dc-cca2094beb8a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:17.112945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4e717ffa-95d7-4e88-b3dc-cca2094beb8a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:17.150160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4e717ffa-95d7-4e88-b3dc-cca2094beb8a tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056567 Aug 01 22:51:17.150978 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 431/884] 10.222.0.47 () {60 vars in 1343 bytes} [Mon Aug 1 22:51:17 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:17.248903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:17.249852 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:17.257504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:17.257972 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:17.258751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:17.259179 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:17.299939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:51:17.405379 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0437225a-d426-4ee1-8789-90228890e452 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 204 len: 0 microversion: 2.20 time: 0.165785 Aug 01 22:51:17.409807 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 454/885] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 1 22:51:17 2022] DELETE /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 22:51:17.418494 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:17.419322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:17.429292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:17.430974 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:17.432451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:17.433191 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:17.618384 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:17.627872 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:17.629373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:17.630616 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e9f46cf7-0655-499d-977e-cb8797b9188c tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.218976 Aug 01 22:51:17.631199 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 432/886] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:51:17 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:51:18.657468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:18.658408 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:18.665761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:18.666202 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:18.667337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:18.667789 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:18.835290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:18.849488 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:18.852868 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:18.855203 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e150b9b8-5f72-4916-bf57-87d126733e75 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.202117 Aug 01 22:51:18.856842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 455/887] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:51:18 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 22:51:19.883924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:19.884497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:19.891671 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:19.892125 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:19.892901 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:19.893338 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:20.124290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:20.134036 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:20.135536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527b7873931742049db9f44104396686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cf343ab1cd4658997298d18a083f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:20.137235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f042612b-9c45-4c55-a349-05e777e8faed tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 200 len: 1723 microversion: 2.20 time: 0.259294 Aug 01 22:51:20.137866 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 433/888] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:51:19 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 22:51:20.472245 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-3d161240-5557-4f14-8e0b-cb1687505694 req-b275543b-88ad-46ac-817e-4bcb06346c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d46d04-c425-4550-81d2-b81ae445092c", "name": "network-vif-deleted", "tag": "8337104d-1ac5-46da-a5b2-bf7d7c573998"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:20.478958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:20.484846 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-3d161240-5557-4f14-8e0b-cb1687505694 req-b275543b-88ad-46ac-817e-4bcb06346c8d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:20.485298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-3d161240-5557-4f14-8e0b-cb1687505694 req-b275543b-88ad-46ac-817e-4bcb06346c8d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:20.499845 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-3d161240-5557-4f14-8e0b-cb1687505694 req-b275543b-88ad-46ac-817e-4bcb06346c8d service nova] Creating event network-vif-deleted:8337104d-1ac5-46da-a5b2-bf7d7c573998 for instance b9d46d04-c425-4550-81d2-b81ae445092c on hv-cinder-85164 Aug 01 22:51:20.512120 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-3d161240-5557-4f14-8e0b-cb1687505694 req-b275543b-88ad-46ac-817e-4bcb06346c8d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043435 Aug 01 22:51:20.513064 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 456/889] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:21.161326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:21.162920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:21.170328 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:21.171047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:21.171839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:21.172265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:21.187147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] HTTP exception thrown: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Request method failure captured: Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c HTTP/1.1 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcLhPohGbeO6MICRMWU5wqmJN2183om2-hSXa9UkS2qG35wbtp_uQcXpWw1bC3_9Nh7s108Rgd_BWQsik_y7cBNoxuP-KkV9RaLXh0Zl2dDhFPy02_9QGDI1h-IUBRsFxcGpAiwF4Rn9QPxbQ80FBsjXo6RFIX7lRnaUY7a0UQfnA8 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:51:21.188829 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_96cf343ab1cd4658997298d18a083f29", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 527b7873931742049db9f44104396686 Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:21.190698 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'b9d46d04-c425-4550-81d2-b81ae445092c'} Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:51:21.192276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:21.194747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:21.197204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Returning 404 to user: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:51:21.197204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3042acab-e115-41ee-82d6-75b62c5944e1 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 404 len: 111 microversion: 2.20 time: 0.033021 Aug 01 22:51:21.197204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 434/890] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:51:21 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:51:21.202135 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-54855395-1aae-46fc-9a1c-f9edcd026ab6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '.version_select at 0x7fc5417ee5e0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:21.226125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-54855395-1aae-46fc-9a1c-f9edcd026ab6 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655587982" status: 204 len: 0 microversion: 2.20 time: 0.028738 Aug 01 22:51:21.226736 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 457/891] 10.222.0.47 () {60 vars in 1259 bytes} [Mon Aug 1 22:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655587982 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 22:51:23.099340 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:23.099912 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:23.102282 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:23.108547 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:23.109142 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:23.110079 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:23.110586 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:23.114289 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:23.128072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] HTTP exception thrown: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Request method failure captured: Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c HTTP/1.1 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcLhPohGbeO6MICRMWU5wqmJN2183om2-hSXa9UkS2qG35wbtp_uQcXpWw1bC3_9Nh7s108Rgd_BWQsik_y7cBNoxuP-KkV9RaLXh0Zl2dDhFPy02_9QGDI1h-IUBRsFxcGpAiwF4Rn9QPxbQ80FBsjXo6RFIX7lRnaUY7a0UQfnA8 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:51:23.129874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_96cf343ab1cd4658997298d18a083f29", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 527b7873931742049db9f44104396686 Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.131293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'b9d46d04-c425-4550-81d2-b81ae445092c'} Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:51:23.134982 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.136221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.137453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Returning 404 to user: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:51:23.137453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b78e9333-0444-4d4f-b84c-66d12027abc3 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 404 len: 111 microversion: 2.20 time: 0.035980 Aug 01 22:51:23.137453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 435/892] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 1 22:51:23 2022] DELETE /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:51:23.142028 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:23.142783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: b9d46d04-c425-4550-81d2-b81ae445092c] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:23.149293 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:23.149810 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:23.150601 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:23.151066 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:23.169311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] HTTP exception thrown: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Request method failure captured: Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c HTTP/1.1 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcLhPohGbeO6MICRMWU5wqmJN2183om2-hSXa9UkS2qG35wbtp_uQcXpWw1bC3_9Nh7s108Rgd_BWQsik_y7cBNoxuP-KkV9RaLXh0Zl2dDhFPy02_9QGDI1h-IUBRsFxcGpAiwF4Rn9QPxbQ80FBsjXo6RFIX7lRnaUY7a0UQfnA8 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:51:23.171327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_96cf343ab1cd4658997298d18a083f29", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 527b7873931742049db9f44104396686 Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.174494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'b9d46d04-c425-4550-81d2-b81ae445092c'} Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:51:23.175985 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. Aug 01 22:51:23.178742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:23.180991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Returning 404 to user: Instance b9d46d04-c425-4550-81d2-b81ae445092c could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:51:23.180991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f33fb864-9f63-4bd1-955b-fa3dd215d6ae tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c" status: 404 len: 111 microversion: 2.20 time: 0.037020 Aug 01 22:51:23.180991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 458/893] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:51:23 2022] GET /compute/v2.1/servers/b9d46d04-c425-4550-81d2-b81ae445092c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:51:24.335943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:24.336725 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:24.344958 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:24.345497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:24.346421 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:24.346869 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:24.365908 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] HTTP exception thrown: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Request method failure captured: Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d HTTP/1.1 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FcLhPohGbeO6MICRMWU5wqmJN2183om2-hSXa9UkS2qG35wbtp_uQcXpWw1bC3_9Nh7s108Rgd_BWQsik_y7cBNoxuP-KkV9RaLXh0Zl2dDhFPy02_9QGDI1h-IUBRsFxcGpAiwF4Rn9QPxbQ80FBsjXo6RFIX7lRnaUY7a0UQfnA8 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:51:24.368230 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_96cf343ab1cd4658997298d18a083f29", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 527b7873931742049db9f44104396686 Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.369910 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d'} Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:51:24.370634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.371839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.373318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Returning 404 to user: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:51:24.373318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ad322814-c073-4fec-88bd-2a4f4103a553 tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 404 len: 111 microversion: 2.20 time: 0.038007 Aug 01 22:51:24.373318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 436/894] 10.222.0.47 () {60 vars in 1280 bytes} [Mon Aug 1 22:51:24 2022] DELETE /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 22:51:24.379053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:24.379754 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] [instance: 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:24.387225 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:24.387677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:24.388891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:24.389542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:24.405818 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] HTTP exception thrown: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Request method failure captured: Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d HTTP/1.1 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FcLhPohGbeO6MICRMWU5wqmJN2183om2-hSXa9UkS2qG35wbtp_uQcXpWw1bC3_9Nh7s108Rgd_BWQsik_y7cBNoxuP-KkV9RaLXh0Zl2dDhFPy02_9QGDI1h-IUBRsFxcGpAiwF4Rn9QPxbQ80FBsjXo6RFIX7lRnaUY7a0UQfnA8 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:51:24.407367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_96cf343ab1cd4658997298d18a083f29", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/96cf343ab1cd4658997298d18a083f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 96cf343ab1cd4658997298d18a083f29 Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-705263148 Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 527b7873931742049db9f44104396686 Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-705263148-project Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.408924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d'} Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:51:24.409844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. Aug 01 22:51:24.411306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:51:24.412597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] Returning 404 to user: Instance 6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:51:24.412597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b41618a2-3108-4269-af7d-bcc46a2a3c4e tempest-AttachVolumeShelveTestJSON-705263148 tempest-AttachVolumeShelveTestJSON-705263148-project] 10.222.0.47 "GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d" status: 404 len: 111 microversion: 2.20 time: 0.034870 Aug 01 22:51:24.412597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 459/895] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Aug 1 22:51:24 2022] GET /compute/v2.1/servers/6ab1ddf1-fc2f-4ffd-ad39-8b5eaecd3c1d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:51:29.338819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-66465481-1b17-4638-93f7-fda82269b500 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Action: 'create', calling method: .version_select at 0x7fc54173fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1864245869", "metadata": {"Type": "work"}}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:29.691088 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-66465481-1b17-4638-93f7-fda82269b500 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.554831 Aug 01 22:51:29.691826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 437/896] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 1 22:51:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 556 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 22:51:29.709077 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c1d6db23-2684-4f2b-8bf5-718572554970 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Calling method '.version_select at 0x7fc5417d5820>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:29.775001 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c1d6db23-2684-4f2b-8bf5-718572554970 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518" status: 200 len: 353 microversion: 2.1 time: 0.071311 Aug 01 22:51:29.776003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 460/897] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:51:29 2022] GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:30.793769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2b3f9175-a9dc-4ef5-b053-aa358c017b2a tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Calling method '.version_select at 0x7fc54179c310>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:30.843473 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2b3f9175-a9dc-4ef5-b053-aa358c017b2a tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518" status: 200 len: 354 microversion: 2.1 time: 0.054730 Aug 01 22:51:30.844040 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 438/898] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:51:30 2022] GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:30.859553 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9a068b3c-08a0-4e78-baad-fbfbc3f25fc7 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Calling method '.version_select at 0x7fc5418203a0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:30.914752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9a068b3c-08a0-4e78-baad-fbfbc3f25fc7 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518" status: 200 len: 354 microversion: 2.1 time: 0.061815 Aug 01 22:51:30.915403 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 461/899] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:51:30 2022] GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:30.932748 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2d9988a3-0558-4fac-bba5-6bccf45e93c5 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Calling method '.version_select at 0x7fc5417d0f70>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:31.003119 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2d9988a3-0558-4fac-bba5-6bccf45e93c5 tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518" status: 202 len: 0 microversion: 2.1 time: 0.074149 Aug 01 22:51:31.003673 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 439/900] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:51:30 2022] DELETE /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:51:31.017506 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4236ea82-7de4-4797-8733-636b6dcd511a tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Calling method '.version_select at 0x7fc541820040>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:31.069967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4236ea82-7de4-4797-8733-636b6dcd511a tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518" status: 200 len: 353 microversion: 2.1 time: 0.056213 Aug 01 22:51:31.070589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 462/901] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:51:31 2022] GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:51:32.084154 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-efda568a-fbc9-4f7d-90ad-506d786bc20c tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Calling method '.version_select at 0x7fc542239e50>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:32.113519 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-efda568a-fbc9-4f7d-90ad-506d786bc20c tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] HTTP exception thrown: Volume 3fb439fa-d480-4576-b735-92891603b518 could not be found. Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-efda568a-fbc9-4f7d-90ad-506d786bc20c tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Request method failure captured: Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518 HTTP/1.1 Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FjxQCe9j2zfWD2s4E4X9ahcDvfYAIXXehmEXas7DVD_4fHA0jq9xpshfXjNM-unI52qHgDTiVE4eKIVkHYSAxD2_BS9OSP03ZlhOiW0jzJR5CdnMCZYhVg3bThQNPvh1uHj3egAnZV18kgztXDIoRWEMIWf93g0fx5iZ0Ny8CmqKW4 Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 9bce0102892344789fa8eeb849c7fb02 Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesGetTestJSON-157882637 Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:51:32.115543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9bce0102892344789fa8eeb849c7fb02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9bce0102892344789fa8eeb849c7fb02", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9bce0102892344789fa8eeb849c7fb02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9bce0102892344789fa8eeb849c7fb02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesGetTestJSON-157882637 Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 9bce0102892344789fa8eeb849c7fb02 Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesGetTestJSON-157882637 Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesGetTestJSON-157882637-project Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 7a5cda259ff842049b056bd8a223d039 Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesGetTestJSON-157882637-project Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Volume 3fb439fa-d480-4576-b735-92891603b518 could not be found. Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '3fb439fa-d480-4576-b735-92891603b518'} Aug 01 22:51:32.117166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3fb439fa-d480-4576-b735-92891603b518 could not be found. (HTTP 404) (Request-ID: req-894d84c8-e40d-4886-ad99-6fc9886ec70e) Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:32.118324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:51:32.120060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3fb439fa-d480-4576-b735-92891603b518 could not be found. Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 22:51:32.121543 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3fb439fa-d480-4576-b735-92891603b518 could not be found. Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3fb439fa-d480-4576-b735-92891603b518 could not be found. Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-efda568a-fbc9-4f7d-90ad-506d786bc20c tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] Returning 404 to user: Volume 3fb439fa-d480-4576-b735-92891603b518 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-efda568a-fbc9-4f7d-90ad-506d786bc20c tempest-VolumesGetTestJSON-157882637 tempest-VolumesGetTestJSON-157882637-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518" status: 404 len: 109 microversion: 2.1 time: 0.037452 Aug 01 22:51:32.123005 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 440/902] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:51:32 2022] GET /compute/v2.1/os-volumes/3fb439fa-d480-4576-b735-92891603b518 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:51:57.214600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:57.215938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:57.217526 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:57.219794 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:57.221229 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-f30af248-d9b9-42f3-a966-b55f5337ffaf req-97d18995-2b40-4d1c-9f41-81271a3f576c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5b4fd5-f825-4c44-9be7-6e8139ae11b8", "tag": "35b78388-fa60-4721-9b49-2f3ca747180d"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:57.228784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:57.230402 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:51:57.232117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f30af248-d9b9-42f3-a966-b55f5337ffaf req-97d18995-2b40-4d1c-9f41-81271a3f576c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:57.232627 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f30af248-d9b9-42f3-a966-b55f5337ffaf req-97d18995-2b40-4d1c-9f41-81271a3f576c service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:57.235145 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:57.236831 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:57.237952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:57.238680 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:57.248632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-f30af248-d9b9-42f3-a966-b55f5337ffaf req-97d18995-2b40-4d1c-9f41-81271a3f576c service nova] Creating event network-changed:35b78388-fa60-4721-9b49-2f3ca747180d for instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 on hv-cinder-85164 Aug 01 22:51:57.264775 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-f30af248-d9b9-42f3-a966-b55f5337ffaf req-97d18995-2b40-4d1c-9f41-81271a3f576c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050731 Aug 01 22:51:57.266188 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 441/903] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:51:57.277298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:51:57.390619 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ab3dac4c-6157-4277-8980-e8e9794c568e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 204 len: 0 microversion: 2.1 time: 0.178677 Aug 01 22:51:57.391354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 463/904] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:51:57 2022] DELETE /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:51:57.405165 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:57.407148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:57.418624 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:57.419952 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:57.422467 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:57.423597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:57.622320 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:57.631290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4d733e69-7153-401b-83e0-30b4fd559807 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.232777 Aug 01 22:51:57.631806 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 442/905] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:57 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:58.653938 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:58.654838 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:58.667310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.668209 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:58.669283 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.669896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:58.774617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-14137c10-884a-4191-892f-08c81669f9de tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:58.775695 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-14137c10-884a-4191-892f-08c81669f9de tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:58.784292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14137c10-884a-4191-892f-08c81669f9de tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.784527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14137c10-884a-4191-892f-08c81669f9de tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:58.785533 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14137c10-884a-4191-892f-08c81669f9de tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.786044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-14137c10-884a-4191-892f-08c81669f9de tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:58.814356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-14137c10-884a-4191-892f-08c81669f9de tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd/ips" status: 200 len: 151 microversion: 2.1 time: 0.047537 Aug 01 22:51:58.814937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 443/906] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:51:58 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:51:58.828797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2630ade0-c19b-4085-88b8-e3def5cb8515"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:51:58.831479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:58.838116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.838603 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:58.840061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.840510 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:58.907958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:58.940177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fa65f941-950f-447b-8183-dc8fc63f2a49 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.278766 Aug 01 22:51:58.943769 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 464/907] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:58 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:58.970821 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Invalid volume: volume 2630ade0-c19b-4085-88b8-e3def5cb8515 is already attached to instances: bd51e566-5acc-4ac9-8cd0-b9b84e8657de Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: POST /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd/os-volume_attachments HTTP/1.1 Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 74 Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:51:58.972871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {"volumeAttachment": {"volumeId": "2630ade0-c19b-4085-88b8-e3def5cb8515"}} Aug 01 22:51:58.974564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Invalid volume: volume 2630ade0-c19b-4085-88b8-e3def5cb8515 is already attached to instances: bd51e566-5acc-4ac9-8cd0-b9b84e8657de Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'server_id': 'ac705013-d650-48da-afca-8b68f18ca0fd', 'body': {'volumeAttachment': {'volumeId': '2630ade0-c19b-4085-88b8-e3def5cb8515'}}} Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2630ade0-c19b-4085-88b8-e3def5cb8515 is already attached to instances: bd51e566-5acc-4ac9-8cd0-b9b84e8657de Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:58.975532 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2630ade0-c19b-4085-88b8-e3def5cb8515 is already attached to instances: bd51e566-5acc-4ac9-8cd0-b9b84e8657de Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:51:58.977098 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2630ade0-c19b-4085-88b8-e3def5cb8515 is already attached to instances: bd51e566-5acc-4ac9-8cd0-b9b84e8657de Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 400 to user: Invalid volume: volume 2630ade0-c19b-4085-88b8-e3def5cb8515 is already attached to instances: bd51e566-5acc-4ac9-8cd0-b9b84e8657de {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-567a58d0-6956-465d-9a27-5927a79212be tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.150599 Aug 01 22:51:58.978732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 444/908] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:51:58 2022] POST /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:51:58.985061 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:58.985570 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:58.994360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.995134 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:58.995958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:58.996393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:59.024766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:51:59.113360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2a052e5b-e3b2-441c-a898-90a384812e39 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 204 len: 0 microversion: 2.1 time: 0.132089 Aug 01 22:51:59.114131 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 465/909] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:51:58 2022] DELETE /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:51:59.125605 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:59.126563 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:59.136493 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:59.136952 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:59.137769 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:59.138203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:59.402524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:51:59.412868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-f8ea00a3-49d5-4cce-847b-0e7daade1ebd tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1683 microversion: 2.1 time: 0.293011 Aug 01 22:51:59.413459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 445/910] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:59 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1683 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:51:59.976579 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:51:59.977362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:51:59.987723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:59.987723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:51:59.987723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:51:59.987723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:00.135323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:00.144670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-795ab34e-77fa-401a-8e36-cc624182828c tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1570 microversion: 2.1 time: 0.173594 Aug 01 22:52:00.145238 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 466/911] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:51:59 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:00.434567 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:00.435239 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:00.442428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:00.442871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:00.443659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:00.444092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:00.695886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:00.706278 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-59dfa134-308c-4f9b-861f-7634cbdf0df7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1683 microversion: 2.1 time: 0.275417 Aug 01 22:52:00.706999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 446/912] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:00 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1683 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:01.166928 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:01.168364 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:01.176152 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:01.176666 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:01.177591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:01.178117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:01.333403 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:01.341184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dd1f4b14-0f61-456c-a41e-432bac8bc90b tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1451 microversion: 2.1 time: 0.178565 Aug 01 22:52:01.355811 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 467/913] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:01 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1451 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:52:01.503462 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-7d0fae18-2729-44ce-9a72-222316b5b9bf req-cd140061-4788-4a97-8b94-2e0581277197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5b4fd5-f825-4c44-9be7-6e8139ae11b8", "name": "network-vif-deleted", "tag": "35b78388-fa60-4721-9b49-2f3ca747180d"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:01.520235 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7d0fae18-2729-44ce-9a72-222316b5b9bf req-cd140061-4788-4a97-8b94-2e0581277197 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:01.520687 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7d0fae18-2729-44ce-9a72-222316b5b9bf req-cd140061-4788-4a97-8b94-2e0581277197 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:01.533034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-7d0fae18-2729-44ce-9a72-222316b5b9bf req-cd140061-4788-4a97-8b94-2e0581277197 service nova] Creating event network-vif-deleted:35b78388-fa60-4721-9b49-2f3ca747180d for instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 on hv-cinder-85164 Aug 01 22:52:01.539945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-7d0fae18-2729-44ce-9a72-222316b5b9bf req-cd140061-4788-4a97-8b94-2e0581277197 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044333 Aug 01 22:52:01.540806 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 447/914] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:01.731401 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:01.732024 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:01.738594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:01.739027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:01.739789 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:01.740211 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:01.875927 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:01.888323 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-75dbdbb6-009f-4faf-b6ff-2aace76ece99 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 200 len: 1616 microversion: 2.1 time: 0.160922 Aug 01 22:52:01.889937 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 468/915] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:01 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 1616 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:02.368656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:02.369973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:02.378718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:02.379170 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:02.380155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:02.380778 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:02.414042 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:02.414500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:02.415280 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lazy-loading 'fault' on Instance uuid 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:52:02.472595 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfea4c2f4f94cec9cabde2c7822b9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf006ee932d483b9cb06f83b7b86b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:02.483029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d52a9dbf-82af-4308-9289-9334f7ab4ee4 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 200 len: 1224 microversion: 2.1 time: 0.122292 Aug 01 22:52:02.483620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 448/916] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:02 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:02.914162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:02.914841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:02.922444 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:02.922890 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:02.923648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:02.924079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:02.938579 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd HTTP/1.1 Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:52:02.940287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:52:02.941954 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'ac705013-d650-48da-afca-8b68f18ca0fd'} Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:52:02.943137 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:52:02.944636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:02.946367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:52:02.946367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3d87e0c6-095e-44f5-a5c0-6441d423f714 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 404 len: 111 microversion: 2.1 time: 0.034117 Aug 01 22:52:02.946367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 469/917] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:02 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:52:02.951708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e5d3da6e-b96a-44a4-90fb-9214f313ecba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '.version_select at 0x7fc541759550>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:02.973575 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e5d3da6e-b96a-44a4-90fb-9214f313ecba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460697804" status: 202 len: 0 microversion: 2.1 time: 0.025827 Aug 01 22:52:02.974167 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 449/918] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 1 22:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460697804 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:52:03.507710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:03.508420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] [instance: 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:03.523032 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:03.523574 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:03.524457 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:03.524986 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:03.543375 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] HTTP exception thrown: Instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 could not be found. Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Request method failure captured: Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 HTTP/1.1 Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6Feg1FQRoa5NRjFm27wKrbe7mQYDam39PlUJKGI1XYRFgscXLzSrk1hy5e2d0slIecqV5OPE8K-eLppWWDQ-zDBQ_Em2DR0ryqiehzOrcYsg_Uin5rT7dCflJN-8zpMhPllPUfM0Il4qtg9m18ogBAPE5c9_1vGljcYb1Xfkh7Z3a0I Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: dcf006ee932d483b9cb06f83b7b86b47 Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-TestShelveInstance-601029335 Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:52:03.545151 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dcf006ee932d483b9cb06f83b7b86b47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_dcf006ee932d483b9cb06f83b7b86b47", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/dcf006ee932d483b9cb06f83b7b86b47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/dcf006ee932d483b9cb06f83b7b86b47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-TestShelveInstance-601029335 Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: dcf006ee932d483b9cb06f83b7b86b47 Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-TestShelveInstance-601029335 Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-TestShelveInstance-601029335-project Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: bdfea4c2f4f94cec9cabde2c7822b9a9 Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-TestShelveInstance-601029335-project Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 could not be found. Aug 01 22:52:03.546806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '8d5b4fd5-f825-4c44-9be7-6e8139ae11b8'} Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 could not be found. Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:52:03.547751 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 could not be found. Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 could not be found. Aug 01 22:52:03.549216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:52:03.552449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Returning 404 to user: Instance 8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:52:03.553312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c36b7bc2-d6a6-47bb-b98b-b6818c443d6e tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8" status: 404 len: 111 microversion: 2.1 time: 0.052728 Aug 01 22:52:03.557005 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 470/919] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:03 2022] GET /compute/v2.1/servers/8d5b4fd5-f825-4c44-9be7-6e8139ae11b8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:52:03.586546 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-e2fbc068-6708-42f3-bb57-266b11ba9288 req-db131074-768a-4f87-b42c-5babeb8716cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac705013-d650-48da-afca-8b68f18ca0fd", "name": "network-vif-deleted", "tag": "a330fe48-42e4-4fa4-a7ad-44efaa22e7f2"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:03.598617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-e2fbc068-6708-42f3-bb57-266b11ba9288 req-db131074-768a-4f87-b42c-5babeb8716cd service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:03.599155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-e2fbc068-6708-42f3-bb57-266b11ba9288 req-db131074-768a-4f87-b42c-5babeb8716cd service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:03.612957 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-e2fbc068-6708-42f3-bb57-266b11ba9288 req-db131074-768a-4f87-b42c-5babeb8716cd service nova] Creating event network-vif-deleted:a330fe48-42e4-4fa4-a7ad-44efaa22e7f2 for instance ac705013-d650-48da-afca-8b68f18ca0fd on hv-cinder-85164 Aug 01 22:52:03.618375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-e2fbc068-6708-42f3-bb57-266b11ba9288 req-db131074-768a-4f87-b42c-5babeb8716cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037018 Aug 01 22:52:03.619145 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 450/920] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:03.725582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:03.726072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:03.733306 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:03.733870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:03.734716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:03.735228 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:03.749007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-af4dd3c3-f693-49d1-a950-17de49ad8729 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] Calling method '.version_select at 0x7fc54181c3a0>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:03.778219 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-af4dd3c3-f693-49d1-a950-17de49ad8729 tempest-TestShelveInstance-601029335 tempest-TestShelveInstance-601029335-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1274276978" status: 202 len: 0 microversion: 2.1 time: 0.029912 Aug 01 22:52:03.778912 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 451/921] 10.222.0.47 () {58 vars in 1254 bytes} [Mon Aug 1 22:52:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1274276978 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 22:52:03.832293 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lazy-loading 'services' on Instance uuid bd51e566-5acc-4ac9-8cd0-b9b84e8657de {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:52:03.905950 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-620fb7b7-7253-4f1a-8c39-20fdb9adbd62 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments/2630ade0-c19b-4085-88b8-e3def5cb8515" status: 202 len: 0 microversion: 2.1 time: 0.185274 Aug 01 22:52:03.906687 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 471/922] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:52:03 2022] DELETE /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments/2630ade0-c19b-4085-88b8-e3def5cb8515 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:52:03.915271 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ae1b5917-7564-4ef4-831f-e36dd4e65e2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:03.917945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ae1b5917-7564-4ef4-831f-e36dd4e65e2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:03.925646 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1b5917-7564-4ef4-831f-e36dd4e65e2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:03.926287 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1b5917-7564-4ef4-831f-e36dd4e65e2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:03.927252 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1b5917-7564-4ef4-831f-e36dd4e65e2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:03.927759 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ae1b5917-7564-4ef4-831f-e36dd4e65e2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:03.964263 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ae1b5917-7564-4ef4-831f-e36dd4e65e2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052985 Aug 01 22:52:03.965167 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 452/923] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:52:03 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:04.983413 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-487dba96-b5a0-4dd3-9238-acef48506ce0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:04.985980 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-487dba96-b5a0-4dd3-9238-acef48506ce0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:04.992512 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-487dba96-b5a0-4dd3-9238-acef48506ce0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:04.993086 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-487dba96-b5a0-4dd3-9238-acef48506ce0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:04.994055 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-487dba96-b5a0-4dd3-9238-acef48506ce0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:04.994709 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-487dba96-b5a0-4dd3-9238-acef48506ce0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:05.028592 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-487dba96-b5a0-4dd3-9238-acef48506ce0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049976 Aug 01 22:52:05.029227 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 472/924] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:52:04 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:52:05.094024 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:05.094962 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:05.101523 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:05.102453 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:05.103227 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:05.103660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:05.134847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Going to try to terminate instance {{(pid=124356) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:52:05.252272 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-72938840-004b-4583-bf1e-308be5cb5728 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 204 len: 0 microversion: 2.1 time: 0.162393 Aug 01 22:52:05.253291 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 453/925] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:52:05 2022] DELETE /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:52:05.262917 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:05.264021 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:05.271300 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:05.272117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:05.272977 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:05.273716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:05.433789 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:05.442027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7e860a82-c01e-4408-ac91-bf1f78562080 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1682 microversion: 2.1 time: 0.183948 Aug 01 22:52:05.442612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 473/926] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:05 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:06.465846 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:06.466648 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:06.476355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:06.477511 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:06.478809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:06.479471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:06.661615 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:06.670501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5896f67b-8556-4b7e-be17-d9a4a5a6a951 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1682 microversion: 2.1 time: 0.209590 Aug 01 22:52:06.671148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 454/927] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:06 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:07.704952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:07.705594 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:07.712536 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:07.712981 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:07.713782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:07.714277 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:07.892527 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:07.911429 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4c749f20-c5a5-4401-9bc6-f4834bea3be0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1682 microversion: 2.1 time: 0.213825 Aug 01 22:52:07.926586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 474/928] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:07 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:08.612406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-a95b95fa-c51f-4fde-b50c-9f342e5fe217 req-99ed817f-8976-4407-80da-b5d5d7504fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd51e566-5acc-4ac9-8cd0-b9b84e8657de", "name": "network-vif-deleted", "tag": "9793b6b6-447d-4eba-8fe2-80ba086d406e"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:08.626163 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-a95b95fa-c51f-4fde-b50c-9f342e5fe217 req-99ed817f-8976-4407-80da-b5d5d7504fac service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:08.627085 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-a95b95fa-c51f-4fde-b50c-9f342e5fe217 req-99ed817f-8976-4407-80da-b5d5d7504fac service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:08.642635 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-a95b95fa-c51f-4fde-b50c-9f342e5fe217 req-99ed817f-8976-4407-80da-b5d5d7504fac service nova] Creating event network-vif-deleted:9793b6b6-447d-4eba-8fe2-80ba086d406e for instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de on hv-cinder-85164 Aug 01 22:52:08.649353 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-a95b95fa-c51f-4fde-b50c-9f342e5fe217 req-99ed817f-8976-4407-80da-b5d5d7504fac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041055 Aug 01 22:52:08.654793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 455/929] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:08.949646 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:08.951072 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:08.964509 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:08.966206 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:08.967241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:08.967865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:09.022808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:09.023308 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:09.023774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lazy-loading 'fault' on Instance uuid bd51e566-5acc-4ac9-8cd0-b9b84e8657de {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:52:09.164832 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:09.174561 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ac3b0ff3-2518-4724-a022-c9407df1e172 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 200 len: 1332 microversion: 2.1 time: 0.230314 Aug 01 22:52:09.177662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 475/930] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:08 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:10.202782 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:10.203492 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:10.210333 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:10.211003 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:10.211935 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:10.212530 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:10.226937 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de HTTP/1.1 Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:52:10.228781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:52:10.230428 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'bd51e566-5acc-4ac9-8cd0-b9b84e8657de'} Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:52:10.231495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:52:10.232783 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:52:10.233947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:52:10.233947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6a444f44-92e7-44e0-8f21-4f09bfaad032 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 404 len: 111 microversion: 2.1 time: 0.031722 Aug 01 22:52:10.233947 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 456/931] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:10 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:52:10.240230 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c9ee8f2f-258f-4932-bfdc-e7fbff532143 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '.version_select at 0x7fc5417ee040>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:10.269334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c9ee8f2f-258f-4932-bfdc-e7fbff532143 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125996174" status: 202 len: 0 microversion: 2.1 time: 0.032866 Aug 01 22:52:10.275025 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 476/932] 10.222.0.47 () {58 vars in 1221 bytes} [Mon Aug 1 22:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125996174 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:52:11.008497 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9b5afc64-0a12-460d-a182-d62a53dcc098 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: .version_select at 0x7fc541759e50>, body: {"keypair": {"name": "tempest-keypair-195682849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOVHGE/qgJZP+5Fp8uOX/43amYVScT+JmtNeY14PbYIk99p10vuTtjMgQZkzNqNlR8Whp/lQ10ETR+QnC3aivayR0Pc7MGaMZEEvP4USRr6UuE2eWyYwl3KwyKwBvPQ2A=="}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:11.026714 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-9b5afc64-0a12-460d-a182-d62a53dcc098 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:52:11.032797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-9b5afc64-0a12-460d-a182-d62a53dcc098 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:52:11.062533 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9b5afc64-0a12-460d-a182-d62a53dcc098 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057868 Aug 01 22:52:11.064123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 457/933] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:52:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:12.728549 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1952002496", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c13be76-3119-4964-bad8-1e95513c15ff"}], "security_groups": [{"name": "tempest-securitygroup--313903029"}], "key_name": "tempest-keypair-195682849", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:12.857065 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] validate_networks() for [('8c13be76-3119-4964-bad8-1e95513c15ff', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:52:13.310170 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:52:13.310589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:52:13.311062 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:52:13.311469 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:52:13.311881 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:52:13.321542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:13.322471 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:13.323450 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:13.323989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:13.343659 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:52:13.349422 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:52:13.361723 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:52:13.364132 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:52:13.412918 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-463f9fbb-9159-4c13-be47-794b92464f4a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689191 Aug 01 22:52:13.413652 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 477/934] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:52:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:52:13.424984 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8ae5cb73-f8ad-46f8-a911-ac1e6a9f35e1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:13.425634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8ae5cb73-f8ad-46f8-a911-ac1e6a9f35e1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:13.485437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8ae5cb73-f8ad-46f8-a911-ac1e6a9f35e1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:13.492674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8ae5cb73-f8ad-46f8-a911-ac1e6a9f35e1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1241 microversion: 2.1 time: 0.072040 Aug 01 22:52:13.505987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 458/935] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:13 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:14.514767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:14.516067 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:14.523960 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:14.524515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:14.525514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:14.526201 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:14.542225 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:14.605748 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:14.614835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-53dc710c-a895-4fea-b286-f47466472a37 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1299 microversion: 2.1 time: 0.104595 Aug 01 22:52:14.615410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 478/936] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:14 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:15.636344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:15.637201 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:15.644201 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:15.644653 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:15.645422 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:15.645898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:15.881862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:15.890376 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6fd45de1-0aca-4ad9-9c3f-f677d479f536 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1366 microversion: 2.1 time: 0.257961 Aug 01 22:52:15.890965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 459/937] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:15 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:15.976233 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-4fcb8e4e-90ee-4a60-ab0f-5fb8de86d00a req-1d01d02a-0c21-469c-916e-849494442f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f07e887-93a3-4db1-9c93-a42ba85f6f62", "tag": "f1bc4713-c87d-4276-8263-3e6037f8e876"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:15.989430 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-4fcb8e4e-90ee-4a60-ab0f-5fb8de86d00a req-1d01d02a-0c21-469c-916e-849494442f86 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:15.989949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-4fcb8e4e-90ee-4a60-ab0f-5fb8de86d00a req-1d01d02a-0c21-469c-916e-849494442f86 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:16.002292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-4fcb8e4e-90ee-4a60-ab0f-5fb8de86d00a req-1d01d02a-0c21-469c-916e-849494442f86 service nova] Creating event network-changed:f1bc4713-c87d-4276-8263-3e6037f8e876 for instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 on hv-cinder-85164 Aug 01 22:52:16.008254 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-4fcb8e4e-90ee-4a60-ab0f-5fb8de86d00a req-1d01d02a-0c21-469c-916e-849494442f86 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037446 Aug 01 22:52:16.013721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 479/938] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:16.911082 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:16.911810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:16.920153 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:16.920754 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:16.921657 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:16.922169 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:17.065313 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:17.075764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1af02b63-0c9e-48cc-8063-925b83d2dd81 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1366 microversion: 2.1 time: 0.168543 Aug 01 22:52:17.076363 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 460/939] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:16 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:18.098682 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:18.099365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:18.106416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:18.106847 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:18.107621 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:18.108048 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:18.257420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:18.273313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-31141dc4-8362-488e-990f-985b330bcc91 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1366 microversion: 2.1 time: 0.176763 Aug 01 22:52:18.273978 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 480/940] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:18 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:19.297076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:19.297821 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:19.307102 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:19.307694 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:19.308645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:19.309064 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:19.455136 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:19.466208 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-76412f77-eca2-476a-aea8-51ed0a68ed71 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1366 microversion: 2.1 time: 0.174480 Aug 01 22:52:19.467097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 461/941] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:19 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:20.297844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-d1a139d5-c7de-49c6-9d13-36ed7f2b02a6 req-2eb9051a-e0ab-45d5-aedf-62194af7609d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f07e887-93a3-4db1-9c93-a42ba85f6f62", "name": "network-vif-plugged", "status": "completed", "tag": "f1bc4713-c87d-4276-8263-3e6037f8e876"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:20.308189 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-d1a139d5-c7de-49c6-9d13-36ed7f2b02a6 req-2eb9051a-e0ab-45d5-aedf-62194af7609d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:20.308754 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-d1a139d5-c7de-49c6-9d13-36ed7f2b02a6 req-2eb9051a-e0ab-45d5-aedf-62194af7609d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:20.321115 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-d1a139d5-c7de-49c6-9d13-36ed7f2b02a6 req-2eb9051a-e0ab-45d5-aedf-62194af7609d service nova] Creating event network-vif-plugged:f1bc4713-c87d-4276-8263-3e6037f8e876 for instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 on hv-cinder-85164 Aug 01 22:52:20.327473 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-d1a139d5-c7de-49c6-9d13-36ed7f2b02a6 req-2eb9051a-e0ab-45d5-aedf-62194af7609d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Aug 01 22:52:20.328158 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 481/942] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:20.488964 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:20.490101 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:20.497291 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:20.497837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:20.498616 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:20.499047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:20.654904 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:20.663429 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-faed889d-8799-4847-9ad6-f4acdd1771a3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1366 microversion: 2.1 time: 0.178788 Aug 01 22:52:20.664025 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 462/943] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:20 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:21.686828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:21.687539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:21.694251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:21.694689 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:21.695457 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:21.695882 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:21.838662 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:21.847230 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-50576422-0f17-4da8-b895-4810e623d837 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1366 microversion: 2.1 time: 0.165218 Aug 01 22:52:21.847822 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 482/944] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:21 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:22.869130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:22.870330 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:22.877977 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:22.878471 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:22.879264 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:22.879700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:22.884725 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:23.022422 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:23.030244 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c71e72e1-15c3-43e2-bdff-b77129bd6595 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1557 microversion: 2.1 time: 0.165653 Aug 01 22:52:23.030821 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 463/945] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:22 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:23.051090 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aa40bf1d-7805-4b9c-8ac5-07c6c585be82 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:23.051703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aa40bf1d-7805-4b9c-8ac5-07c6c585be82 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:23.058326 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa40bf1d-7805-4b9c-8ac5-07c6c585be82 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:23.058769 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa40bf1d-7805-4b9c-8ac5-07c6c585be82 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:23.059568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa40bf1d-7805-4b9c-8ac5-07c6c585be82 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:23.059994 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa40bf1d-7805-4b9c-8ac5-07c6c585be82 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:23.167909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aa40bf1d-7805-4b9c-8ac5-07c6c585be82 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120641 Aug 01 22:52:23.168606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 483/946] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:52:23 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:52:24.402193 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-ea539125-9ffa-4206-b7dc-da4a35b22e45 req-d510c9c8-8dd4-48cd-ab72-db5c0cf64ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f07e887-93a3-4db1-9c93-a42ba85f6f62", "tag": "f1bc4713-c87d-4276-8263-3e6037f8e876"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:24.409047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:24.414223 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-ea539125-9ffa-4206-b7dc-da4a35b22e45 req-d510c9c8-8dd4-48cd-ab72-db5c0cf64ade service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:24.414743 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-ea539125-9ffa-4206-b7dc-da4a35b22e45 req-d510c9c8-8dd4-48cd-ab72-db5c0cf64ade service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:24.427308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-ea539125-9ffa-4206-b7dc-da4a35b22e45 req-d510c9c8-8dd4-48cd-ab72-db5c0cf64ade service nova] Creating event network-changed:f1bc4713-c87d-4276-8263-3e6037f8e876 for instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 on hv-cinder-85164 Aug 01 22:52:24.432635 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-ea539125-9ffa-4206-b7dc-da4a35b22e45 req-d510c9c8-8dd4-48cd-ab72-db5c0cf64ade service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034729 Aug 01 22:52:24.433648 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 464/947] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:52:33.479801 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:33.480788 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:33.483019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:33.484139 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=24 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:33.768654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-08026cd4-7e7f-4dcc-a18f-cb2d4451736f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Action: 'create', calling method: .version_select at 0x7fc541901700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-525941748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtsqRw8bgT9nbJKyLo9Ac/3aj+FdQu1y+FuSjcSOe6VtIfvh74lgUxGI46Dvvha7319HuD/XUOyfgYoCrC8piBAScKXrEZKKwFDXyA+sNQSJMdFwOtbPvBRj1ZZ63aR9w=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:33.785783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-08026cd4-7e7f-4dcc-a18f-cb2d4451736f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:52:33.789632 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-08026cd4-7e7f-4dcc-a18f-cb2d4451736f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for user 4bba292314fd415f94fb537237d9d898 and project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:52:33.814952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-08026cd4-7e7f-4dcc-a18f-cb2d4451736f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.335952 Aug 01 22:52:33.815606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 484/948] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:52:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:52:50.305502 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:50.306334 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:50.311007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-973284629", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-525941748", "security_groups": [{"name": "tempest-secgroup-smoke-2143579186"}], "block_device_mapping_v2": [{"uuid": "fc6d2aa9-c456-47c1-a000-813e6f5ae208", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ee40167-a18f-4159-bd79-1cfac2235d6d"}]}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:50.429305 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] validate_networks() for [('0ee40167-a18f-4159-bd79-1cfac2235d6d', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:52:50.817110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:52:50.817536 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:52:50.818037 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:52:50.818451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:52:50.818862 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:52:50.828368 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:50.828845 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:50.829859 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:50.830281 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:50.848672 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:52:50.852875 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for user 4bba292314fd415f94fb537237d9d898 and project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:52:50.920146 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:52:50.922375 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc6d2aa9-c456-47c1-a000-813e6f5ae208',volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:52:51.057413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-df1c6e29-aa88-434f-80a7-ce9c02cab80f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753391 Aug 01 22:52:51.058074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 465/949] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:52:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:52:51.069206 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=4 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:51.069866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:52:51.074893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c734c673-565b-4951-a00b-1b9f467bcd7e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:51.075606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c734c673-565b-4951-a00b-1b9f467bcd7e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:51.142894 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c734c673-565b-4951-a00b-1b9f467bcd7e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:51.150223 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c734c673-565b-4951-a00b-1b9f467bcd7e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1093 microversion: 2.1 time: 0.083389 Aug 01 22:52:51.150872 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 485/950] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:51 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:52:52.173488 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:52.175160 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:52.183513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:52.184174 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:52.185119 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:52.185650 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:52.269006 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:52.277764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9c5a002c-910e-4fe6-afa5-94e344262f5e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1209 microversion: 2.1 time: 0.109580 Aug 01 22:52:52.281788 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 466/951] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:52 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:53.299183 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:53.299774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:53.306908 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:53.307339 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:53.308102 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:53.308660 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:53.450187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:53.460352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c290b86e-eb1a-485e-a041-dbd249c4e4b1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.165104 Aug 01 22:52:53.460943 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 486/952] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:53 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:53.529955 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-dac889e2-8b22-4de3-9070-4dcef1f77d8b req-d3090299-ddd3-4c1f-83a0-d28005c37127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513fe11b-f879-4c6f-81fa-6f9747182d90", "tag": "62cfa26a-1ad8-4c12-8bcd-ec04761c6203"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:52:53.541738 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-dac889e2-8b22-4de3-9070-4dcef1f77d8b req-d3090299-ddd3-4c1f-83a0-d28005c37127 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:53.542200 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-dac889e2-8b22-4de3-9070-4dcef1f77d8b req-d3090299-ddd3-4c1f-83a0-d28005c37127 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:53.564738 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-dac889e2-8b22-4de3-9070-4dcef1f77d8b req-d3090299-ddd3-4c1f-83a0-d28005c37127 service nova] Creating event network-changed:62cfa26a-1ad8-4c12-8bcd-ec04761c6203 for instance 513fe11b-f879-4c6f-81fa-6f9747182d90 on hv-cinder-85164 Aug 01 22:52:53.574287 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-dac889e2-8b22-4de3-9070-4dcef1f77d8b req-d3090299-ddd3-4c1f-83a0-d28005c37127 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047391 Aug 01 22:52:53.575500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 467/953] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:52:54.483638 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:54.484451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:54.490802 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:54.491252 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:54.492029 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:54.492470 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:54.627513 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:54.635187 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ce39ed46-aa7a-4eda-9fd5-c362fb00cc86 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.156118 Aug 01 22:52:54.635850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 487/954] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:54 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:55.658658 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:55.659353 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:55.666283 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:55.666739 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:55.667513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:55.667960 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:55.813174 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:55.822288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-17d102ab-1516-4d1f-b5f4-865c9bc0c65c tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.169174 Aug 01 22:52:55.822927 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 468/955] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:55 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:56.849363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:56.850089 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:56.860441 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:56.860886 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:56.861698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:56.862129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:57.007776 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:57.018861 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4592c922-7a87-47ec-ac35-d7981aaae48b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.175986 Aug 01 22:52:57.019462 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 488/956] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:56 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:58.044043 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:58.044659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:58.051750 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:58.052202 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:58.052983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:58.053422 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:58.192225 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:58.199940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ea7caffe-262c-42ab-9818-bfa897feeed0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.162316 Aug 01 22:52:58.200520 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 469/957] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:58 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:52:59.222592 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:52:59.223244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:52:59.230451 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:59.230927 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:59.231767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:52:59.232423 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:52:59.377535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:52:59.389960 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-75bd0726-da12-465c-9940-609c254857f5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.171301 Aug 01 22:52:59.390589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 489/958] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:52:59 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:00.416964 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:00.417613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:00.425840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:00.426284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:00.427048 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:00.427476 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:00.565610 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:00.577834 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1cc9640e-f3a5-47d2-ab57-a97f47fe3a88 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.164821 Aug 01 22:53:00.578541 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 470/959] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:00 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:00.977829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2c5038ec-8c7e-49ba-a462-2ba293bc8173 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:00.978449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2c5038ec-8c7e-49ba-a462-2ba293bc8173 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:00.985596 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5038ec-8c7e-49ba-a462-2ba293bc8173 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:00.986067 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5038ec-8c7e-49ba-a462-2ba293bc8173 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:00.986835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5038ec-8c7e-49ba-a462-2ba293bc8173 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:00.987274 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2c5038ec-8c7e-49ba-a462-2ba293bc8173 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:01.011988 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2c5038ec-8c7e-49ba-a462-2ba293bc8173 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/ips" status: 200 len: 151 microversion: 2.1 time: 0.038257 Aug 01 22:53:01.012563 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 490/960] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:53:00 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:01.604026 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:01.604696 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:01.606941 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:01.607600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:01.614506 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:01.614948 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:01.615708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:01.616132 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:01.757452 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:01.766705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7584928f-5cd5-4d3f-8895-16f0caa21940 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.168910 Aug 01 22:53:01.767522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 471/961] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:01 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:02.389343 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3fa68b6d-d87f-4c74-b7d1-cc26c181a718 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "471dfd88-6781-45b5-9a2e-17b8cf37739b"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:02.391926 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3fa68b6d-d87f-4c74-b7d1-cc26c181a718 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:02.394009 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:02.400042 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3fa68b6d-d87f-4c74-b7d1-cc26c181a718 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:02.400480 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3fa68b6d-d87f-4c74-b7d1-cc26c181a718 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:02.401253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3fa68b6d-d87f-4c74-b7d1-cc26c181a718 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:02.401847 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3fa68b6d-d87f-4c74-b7d1-cc26c181a718 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:02.696078 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3fa68b6d-d87f-4c74-b7d1-cc26c181a718 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310204 Aug 01 22:53:02.696686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 491/962] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:53:02 2022] POST /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:02.788684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:02.791959 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:02.796332 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:02.796826 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:02.797678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:02.798243 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:02.949014 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:02.958907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-313a763e-ae06-43fc-940f-d97f7fc3601e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.174746 Aug 01 22:53:02.959501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 472/963] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:02 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:03.981931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:03.982622 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:03.989841 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:03.990290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:03.991083 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:03.991515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:04.141484 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:04.149905 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-374981f7-3331-4fa4-9a61-5b389e2adbfc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.172816 Aug 01 22:53:04.150477 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 492/964] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:03 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:04.322310 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-dbf4fcda-59b2-4fa4-a285-91e14cac961f req-4d189589-d2ca-411a-bc2f-76f1b144b547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513fe11b-f879-4c6f-81fa-6f9747182d90", "name": "network-vif-plugged", "status": "completed", "tag": "62cfa26a-1ad8-4c12-8bcd-ec04761c6203"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:04.333130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-dbf4fcda-59b2-4fa4-a285-91e14cac961f req-4d189589-d2ca-411a-bc2f-76f1b144b547 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:04.333485 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-dbf4fcda-59b2-4fa4-a285-91e14cac961f req-4d189589-d2ca-411a-bc2f-76f1b144b547 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:04.351617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-dbf4fcda-59b2-4fa4-a285-91e14cac961f req-4d189589-d2ca-411a-bc2f-76f1b144b547 service nova] Creating event network-vif-plugged:62cfa26a-1ad8-4c12-8bcd-ec04761c6203 for instance 513fe11b-f879-4c6f-81fa-6f9747182d90 on hv-cinder-85164 Aug 01 22:53:04.358821 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-dbf4fcda-59b2-4fa4-a285-91e14cac961f req-4d189589-d2ca-411a-bc2f-76f1b144b547 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040108 Aug 01 22:53:04.359905 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 473/965] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:05.171742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:05.172326 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:05.179587 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:05.180069 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:05.180906 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:05.181330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:05.334498 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:05.345571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f59762e4-1ff9-415f-b256-7ac1acb7c232 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1265 microversion: 2.1 time: 0.177922 Aug 01 22:53:05.346188 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 493/966] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:05 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:06.369576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:06.370272 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:06.377202 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:06.377695 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:06.378451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:06.378877 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:06.519264 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:06.527248 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1959057f-6f2a-4d48-b0fa-57b117122ebc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1450 microversion: 2.1 time: 0.162470 Aug 01 22:53:06.527794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 474/967] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:06 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:06.547755 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:06.548384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:06.555012 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:06.555449 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:06.556198 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:06.556626 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:06.695811 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:06.703727 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-db089aca-02d5-42bd-97da-a0c18e28a7b2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1450 microversion: 2.1 time: 0.160076 Aug 01 22:53:06.704298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 494/968] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:06 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:08.721173 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-7eaf4a04-7580-4a9f-8ad4-cd221be8c1a9 req-516c5061-2966-4852-8a32-3f85727081ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513fe11b-f879-4c6f-81fa-6f9747182d90", "tag": "62cfa26a-1ad8-4c12-8bcd-ec04761c6203"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:08.730524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7eaf4a04-7580-4a9f-8ad4-cd221be8c1a9 req-516c5061-2966-4852-8a32-3f85727081ac service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:08.731052 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7eaf4a04-7580-4a9f-8ad4-cd221be8c1a9 req-516c5061-2966-4852-8a32-3f85727081ac service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:08.746249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-7eaf4a04-7580-4a9f-8ad4-cd221be8c1a9 req-516c5061-2966-4852-8a32-3f85727081ac service nova] Creating event network-changed:62cfa26a-1ad8-4c12-8bcd-ec04761c6203 for instance 513fe11b-f879-4c6f-81fa-6f9747182d90 on hv-cinder-85164 Aug 01 22:53:08.753597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-7eaf4a04-7580-4a9f-8ad4-cd221be8c1a9 req-516c5061-2966-4852-8a32-3f85727081ac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037068 Aug 01 22:53:08.754714 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 475/969] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:09.243703 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "471dfd88-6781-45b5-9a2e-17b8cf37739b"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:09.246783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:09.253287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:09.253834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:09.254699 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:09.255191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:09.356664 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Invalid volume: volume 471dfd88-6781-45b5-9a2e-17b8cf37739b is already attached to instances: 0f07e887-93a3-4db1-9c93-a42ba85f6f62 Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: POST /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments HTTP/1.1 Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 74 Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:53:09.359043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {"volumeAttachment": {"volumeId": "471dfd88-6781-45b5-9a2e-17b8cf37739b"}} Aug 01 22:53:09.361697 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Invalid volume: volume 471dfd88-6781-45b5-9a2e-17b8cf37739b is already attached to instances: 0f07e887-93a3-4db1-9c93-a42ba85f6f62 Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'server_id': '0f07e887-93a3-4db1-9c93-a42ba85f6f62', 'body': {'volumeAttachment': {'volumeId': '471dfd88-6781-45b5-9a2e-17b8cf37739b'}}} Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 471dfd88-6781-45b5-9a2e-17b8cf37739b is already attached to instances: 0f07e887-93a3-4db1-9c93-a42ba85f6f62 Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:53:09.362772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 471dfd88-6781-45b5-9a2e-17b8cf37739b is already attached to instances: 0f07e887-93a3-4db1-9c93-a42ba85f6f62 Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:53:09.364285 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 471dfd88-6781-45b5-9a2e-17b8cf37739b is already attached to instances: 0f07e887-93a3-4db1-9c93-a42ba85f6f62 Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 400 to user: Invalid volume: volume 471dfd88-6781-45b5-9a2e-17b8cf37739b is already attached to instances: 0f07e887-93a3-4db1-9c93-a42ba85f6f62 {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-543a21b7-8e03-4928-aaef-8af3d4245921 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122108 Aug 01 22:53:09.366572 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 495/970] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:53:09 2022] POST /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 22:53:09.441791 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:09.442378 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:09.449391 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:09.450168 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:09.450968 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:09.451413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:09.544158 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.objects.instance [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lazy-loading 'services' on Instance uuid 0f07e887-93a3-4db1-9c93-a42ba85f6f62 {{(pid=124356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:53:09.638357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a43df3ab-137f-440f-a335-e1f548476e32 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments/471dfd88-6781-45b5-9a2e-17b8cf37739b" status: 202 len: 0 microversion: 2.1 time: 0.200557 Aug 01 22:53:09.638949 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 476/971] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:53:09 2022] DELETE /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments/471dfd88-6781-45b5-9a2e-17b8cf37739b => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:53:09.647806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-42276db3-0210-4f67-af62-94fab5fbbc89 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:09.650113 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-42276db3-0210-4f67-af62-94fab5fbbc89 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:09.665416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42276db3-0210-4f67-af62-94fab5fbbc89 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:09.665901 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42276db3-0210-4f67-af62-94fab5fbbc89 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:09.666693 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42276db3-0210-4f67-af62-94fab5fbbc89 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:09.667438 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-42276db3-0210-4f67-af62-94fab5fbbc89 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:09.701220 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-42276db3-0210-4f67-af62-94fab5fbbc89 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057537 Aug 01 22:53:09.701829 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 496/972] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:53:09 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:10.715110 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5e01d249-b89b-4953-8230-8472d510ea8e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:10.717338 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5e01d249-b89b-4953-8230-8472d510ea8e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:10.724645 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e01d249-b89b-4953-8230-8472d510ea8e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:10.725086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e01d249-b89b-4953-8230-8472d510ea8e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:10.726122 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e01d249-b89b-4953-8230-8472d510ea8e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:10.726789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5e01d249-b89b-4953-8230-8472d510ea8e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:10.763654 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5e01d249-b89b-4953-8230-8472d510ea8e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053417 Aug 01 22:53:10.764245 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 477/973] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:53:10 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:53:10.830280 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:10.830811 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:10.837551 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:10.838031 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:10.838767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:10.839219 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:10.865332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:53:10.955407 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a45a95bf-2698-43fd-8b7d-b29bc0bea422 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 204 len: 0 microversion: 2.1 time: 0.128657 Aug 01 22:53:10.956010 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 497/974] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:53:10 2022] DELETE /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:53:10.964676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:10.965295 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:10.972164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:10.973008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:10.973416 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:10.974004 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:11.128597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:11.137624 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d5f9435a-6b6d-4cd9-b25b-613c5376a47f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1682 microversion: 2.1 time: 0.176578 Aug 01 22:53:11.138322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 478/975] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:10 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:12.160393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:12.161393 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:12.168417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:12.168858 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:12.169656 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:12.170084 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:12.379936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:12.388030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3022de3e-79c1-430c-8b86-4246cab1977b tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1682 microversion: 2.1 time: 0.232235 Aug 01 22:53:12.388604 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 498/976] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:12 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:13.411307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:13.412176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:13.419661 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:13.420283 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:13.421262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:13.421855 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:13.512443 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:13.521019 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9f306b8e-c973-41ba-bbc0-6a7c186e402d tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 200 len: 1615 microversion: 2.1 time: 0.114280 Aug 01 22:53:13.521593 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 479/977] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:13 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 1615 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:13.595747 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-180f6c9d-990a-4302-8f67-4db4546fbc96 req-b48b1248-b56e-4c96-9cac-22faa204db81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f07e887-93a3-4db1-9c93-a42ba85f6f62", "name": "network-vif-deleted", "tag": "f1bc4713-c87d-4276-8263-3e6037f8e876"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:13.612920 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-180f6c9d-990a-4302-8f67-4db4546fbc96 req-b48b1248-b56e-4c96-9cac-22faa204db81 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:13.613352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-180f6c9d-990a-4302-8f67-4db4546fbc96 req-b48b1248-b56e-4c96-9cac-22faa204db81 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:13.634598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-180f6c9d-990a-4302-8f67-4db4546fbc96 req-b48b1248-b56e-4c96-9cac-22faa204db81 service nova] Creating event network-vif-deleted:f1bc4713-c87d-4276-8263-3e6037f8e876 for instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 on hv-cinder-85164 Aug 01 22:53:13.641008 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-180f6c9d-990a-4302-8f67-4db4546fbc96 req-b48b1248-b56e-4c96-9cac-22faa204db81 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049003 Aug 01 22:53:13.642101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 499/978] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:14.543108 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:14.543682 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:14.550837 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:14.551283 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:14.552061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:14.552494 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:14.566976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 HTTP/1.1 Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:53:14.568623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:53:14.570155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '0f07e887-93a3-4db1-9c93-a42ba85f6f62'} Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:53:14.571150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:53:14.572724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:53:14.574123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:53:14.574123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-62e5f955-75e6-4fa9-8452-b03b900ffc78 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 404 len: 111 microversion: 2.1 time: 0.030953 Aug 01 22:53:14.574123 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 480/979] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:14 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:53:14.579754 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c6c4879b-f5cb-4939-b966-32946ea3d1d0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '.version_select at 0x7fc5417d5ca0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:14.601915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c6c4879b-f5cb-4939-b966-32946ea3d1d0 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-195682849" status: 202 len: 0 microversion: 2.1 time: 0.025849 Aug 01 22:53:14.602934 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 500/980] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 1 22:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-195682849 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:53:15.224578 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-10165a4a-00bb-4cc0-8ad8-d72762f16374 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: .version_select at 0x7fc54179e3a0>, body: {"keypair": {"name": "tempest-keypair-476814707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8iYOi4DXyDpBngkTeFGyUOYgprhbsCIBlzlBENX2bG7UWtWC6Mn203EKA2tR2EwgWz2l7rGhG8Zw04doxrjY/FEtcwUO6Chfl/k0GRKCfH48Cwdi4CoYTdKyHUAOCPvg=="}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:15.240876 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-10165a4a-00bb-4cc0-8ad8-d72762f16374 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:53:15.244804 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-10165a4a-00bb-4cc0-8ad8-d72762f16374 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'key_pairs'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:53:15.271751 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-10165a4a-00bb-4cc0-8ad8-d72762f16374 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051123 Aug 01 22:53:15.272416 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 481/981] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:53:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:16.591555 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-358398921", "imageRef": "fb0190bd-9ce6-4e2a-8078-b76a6255b07c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c13be76-3119-4964-bad8-1e95513c15ff"}], "security_groups": [{"name": "tempest-securitygroup--129166651"}], "key_name": "tempest-keypair-476814707", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:16.697790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] validate_networks() for [('8c13be76-3119-4964-bad8-1e95513c15ff', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:53:17.095742 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:53:17.096165 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:53:17.096639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:53:17.097045 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:53:17.097483 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:53:17.108364 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:17.108931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:17.109784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:17.110314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:17.127459 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:53:17.131654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Getting quotas for user 578e52fe28d54963b9450f607a5cd0ab and project 01fc0c1edc794389a289555d518bfcbb. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:53:17.143854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:53:17.146284 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb0190bd-9ce6-4e2a-8078-b76a6255b07c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:53:17.202875 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-10826fea-2015-4259-b192-77165878f4ba tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.619245 Aug 01 22:53:17.203527 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 501/982] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:53:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:53:17.216860 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-b2dc162b-c4bf-4600-af9b-18d91ebd730c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:17.217938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-b2dc162b-c4bf-4600-af9b-18d91ebd730c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:17.339121 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-b2dc162b-c4bf-4600-af9b-18d91ebd730c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:17.347456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-b2dc162b-c4bf-4600-af9b-18d91ebd730c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1240 microversion: 2.1 time: 0.134971 Aug 01 22:53:17.348035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 482/983] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:17 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:18.370941 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:18.371856 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:18.379335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:18.379775 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:18.380539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:18.380976 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:18.387210 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:18.449615 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:18.458453 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e058eb87-ac3d-4470-8de7-ba7c26c9a691 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1236 microversion: 2.1 time: 0.093280 Aug 01 22:53:18.459034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 502/984] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:18 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:19.481140 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:19.482046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:19.489583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:19.490013 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:19.490844 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:19.491352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:19.727065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:19.736764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bf112568-346d-4282-ba3d-152413ef4561 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.260027 Aug 01 22:53:19.737341 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 483/985] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:19 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:20.760826 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:20.761395 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:20.768177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:20.768626 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:20.769385 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:20.769844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:20.908034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:20.915715 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d0bed060-486d-46a2-995c-8e0d53279b06 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.159105 Aug 01 22:53:20.916321 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 503/986] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:20 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:20.982290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-655bef11-8771-468d-8134-5ae1fd43adb1 req-9f0461b2-da51-4e4c-8d95-e473849ef3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f63444-8160-47ae-820d-4e2772669a50", "tag": "fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:20.988446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:20.997721 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-655bef11-8771-468d-8134-5ae1fd43adb1 req-9f0461b2-da51-4e4c-8d95-e473849ef3b1 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:20.998606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-655bef11-8771-468d-8134-5ae1fd43adb1 req-9f0461b2-da51-4e4c-8d95-e473849ef3b1 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:21.003514 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:21.014966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-655bef11-8771-468d-8134-5ae1fd43adb1 req-9f0461b2-da51-4e4c-8d95-e473849ef3b1 service nova] Creating event network-changed:fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05 for instance d0f63444-8160-47ae-820d-4e2772669a50 on hv-cinder-85164 Aug 01 22:53:21.020397 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-655bef11-8771-468d-8134-5ae1fd43adb1 req-9f0461b2-da51-4e4c-8d95-e473849ef3b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042044 Aug 01 22:53:21.021044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 484/987] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:21.938409 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:21.939079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:21.941334 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:21.946984 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:21.947423 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:21.948297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:21.948740 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:22.096806 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:22.109288 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d4765c3a-7357-484f-811a-a8e647c5469e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.175040 Aug 01 22:53:22.109904 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 504/988] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:21 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:23.131617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:23.132364 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:23.143614 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:23.144063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:23.144834 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:23.145270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:23.289007 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:23.297924 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-75dba563-506c-4b28-b083-6e5455b18ba5 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.171415 Aug 01 22:53:23.298850 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 485/989] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:23 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:24.319740 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:24.320610 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:24.327887 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:24.328352 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:24.329118 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:24.329548 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:24.467709 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:24.476443 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f6bfdb4b-e562-44a4-8f49-f49c20f198ab tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.160636 Aug 01 22:53:24.477032 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 505/990] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:24 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:25.498984 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:25.499671 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:25.507115 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:25.507594 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:25.508367 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:25.508936 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:25.652028 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:25.659805 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2cb8a8ab-aa2b-49e3-9575-ad4db26b6dc9 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.165656 Aug 01 22:53:25.660392 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 486/991] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:25 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:26.429587 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-038d48f5-2899-412d-9792-e55ad95808c4 req-dafdd7fa-e03e-4831-9251-c8cef219548f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f63444-8160-47ae-820d-4e2772669a50", "name": "network-vif-plugged", "status": "completed", "tag": "fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:26.442361 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-038d48f5-2899-412d-9792-e55ad95808c4 req-dafdd7fa-e03e-4831-9251-c8cef219548f service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:26.442805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-038d48f5-2899-412d-9792-e55ad95808c4 req-dafdd7fa-e03e-4831-9251-c8cef219548f service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:26.455150 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-038d48f5-2899-412d-9792-e55ad95808c4 req-dafdd7fa-e03e-4831-9251-c8cef219548f service nova] Creating event network-vif-plugged:fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05 for instance d0f63444-8160-47ae-820d-4e2772669a50 on hv-cinder-85164 Aug 01 22:53:26.460294 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-038d48f5-2899-412d-9792-e55ad95808c4 req-dafdd7fa-e03e-4831-9251-c8cef219548f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035710 Aug 01 22:53:26.460903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 506/992] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:26.680509 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:26.681109 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:26.688477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:26.688925 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:26.689749 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:26.690184 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:26.826380 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:26.834772 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-ec3dd28e-e416-4a11-b591-a80544be36f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.158063 Aug 01 22:53:26.835353 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 487/993] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:26 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:27.855409 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:27.856686 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:27.861273 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:27.861982 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:27.869546 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:27.870258 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:27.871035 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:27.871476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:28.028229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:28.036510 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-55b8b9c7-abba-44c3-b8e9-69880ffff82a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1365 microversion: 2.1 time: 0.183035 Aug 01 22:53:28.037064 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 507/994] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:27 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:29.057720 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:29.058587 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:29.061038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:53:29.066827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:29.067268 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:29.068029 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:29.068458 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:29.204480 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:53:29.212441 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-699654da-08cd-41bb-8da9-3ed9af6ceb2e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1555 microversion: 2.1 time: 0.158574 Aug 01 22:53:29.213064 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 488/995] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:53:29 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:53:29.233593 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d002c42a-502d-478f-ab69-fe4a9a5168d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:53:29.234241 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d002c42a-502d-478f-ab69-fe4a9a5168d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:53:29.240939 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d002c42a-502d-478f-ab69-fe4a9a5168d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:29.241374 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d002c42a-502d-478f-ab69-fe4a9a5168d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:29.242162 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d002c42a-502d-478f-ab69-fe4a9a5168d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:29.242583 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d002c42a-502d-478f-ab69-fe4a9a5168d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:29.323930 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d002c42a-502d-478f-ab69-fe4a9a5168d7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094413 Aug 01 22:53:29.324542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 508/996] 10.222.0.47 () {58 vars in 1275 bytes} [Mon Aug 1 22:53:29 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:53:30.558764 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-d4d7ad2c-d129-4d03-9eff-ccb4ca737b96 req-4431b9f0-f607-486c-9c34-5ae2b1a92805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f63444-8160-47ae-820d-4e2772669a50", "tag": "fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:53:30.569747 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-d4d7ad2c-d129-4d03-9eff-ccb4ca737b96 req-4431b9f0-f607-486c-9c34-5ae2b1a92805 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:53:30.570377 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-d4d7ad2c-d129-4d03-9eff-ccb4ca737b96 req-4431b9f0-f607-486c-9c34-5ae2b1a92805 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:53:30.582410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-d4d7ad2c-d129-4d03-9eff-ccb4ca737b96 req-4431b9f0-f607-486c-9c34-5ae2b1a92805 service nova] Creating event network-changed:fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05 for instance d0f63444-8160-47ae-820d-4e2772669a50 on hv-cinder-85164 Aug 01 22:53:30.587900 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-d4d7ad2c-d129-4d03-9eff-ccb4ca737b96 req-4431b9f0-f607-486c-9c34-5ae2b1a92805 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032818 Aug 01 22:53:30.588508 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 489/997] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:54:06.654407 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=9 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:06.655142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=34 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:06.659759 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-892b3bfd-b867-49e5-872b-9cd375ff603e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:06.660251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-892b3bfd-b867-49e5-872b-9cd375ff603e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:06.667402 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892b3bfd-b867-49e5-872b-9cd375ff603e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:06.667836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892b3bfd-b867-49e5-872b-9cd375ff603e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:06.668603 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892b3bfd-b867-49e5-872b-9cd375ff603e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:06.669027 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-892b3bfd-b867-49e5-872b-9cd375ff603e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:06.695121 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-892b3bfd-b867-49e5-872b-9cd375ff603e tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/ips" status: 200 len: 149 microversion: 2.1 time: 0.042217 Aug 01 22:54:06.695702 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 509/998] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:54:06 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:08.070768 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=11 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:08.071512 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=27 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:08.076218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bc56fecc-df9a-492d-bc71-521324c83d67 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b8c2d67-dd7b-4f1c-aaab-9e6af50c73b1"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:54:08.078744 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bc56fecc-df9a-492d-bc71-521324c83d67 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:08.085866 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc56fecc-df9a-492d-bc71-521324c83d67 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:08.086312 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc56fecc-df9a-492d-bc71-521324c83d67 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:08.087080 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc56fecc-df9a-492d-bc71-521324c83d67 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:08.087516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bc56fecc-df9a-492d-bc71-521324c83d67 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:08.364499 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bc56fecc-df9a-492d-bc71-521324c83d67 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "POST /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295189 Aug 01 22:54:08.365257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 490/999] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:54:08 2022] POST /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:16.091397 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:16.091971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:16.099199 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:16.099580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:16.100379 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:16.100821 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:16.191873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lazy-loading 'services' on Instance uuid d0f63444-8160-47ae-820d-4e2772669a50 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:54:16.274739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ba0490af-94a5-47fd-9e04-b7eb159c0862 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments/4b8c2d67-dd7b-4f1c-aaab-9e6af50c73b1" status: 202 len: 0 microversion: 2.1 time: 0.187055 Aug 01 22:54:16.275313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 510/1000] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:54:16 2022] DELETE /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments/4b8c2d67-dd7b-4f1c-aaab-9e6af50c73b1 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:54:16.286961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-962d87e7-b996-4268-966a-c479933da0fa tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:16.289324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-962d87e7-b996-4268-966a-c479933da0fa tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:16.295838 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-962d87e7-b996-4268-966a-c479933da0fa tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:16.296285 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-962d87e7-b996-4268-966a-c479933da0fa tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:16.297061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-962d87e7-b996-4268-966a-c479933da0fa tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:16.297492 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-962d87e7-b996-4268-966a-c479933da0fa tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:16.328850 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-962d87e7-b996-4268-966a-c479933da0fa tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 Aug 01 22:54:16.329406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 491/1001] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:54:16 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:17.344888 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dd63bfd4-d1b3-4cfc-bfd8-7ca4318b8491 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:17.348490 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dd63bfd4-d1b3-4cfc-bfd8-7ca4318b8491 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:17.359898 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd63bfd4-d1b3-4cfc-bfd8-7ca4318b8491 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:17.360483 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd63bfd4-d1b3-4cfc-bfd8-7ca4318b8491 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:17.361744 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd63bfd4-d1b3-4cfc-bfd8-7ca4318b8491 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:17.362392 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dd63bfd4-d1b3-4cfc-bfd8-7ca4318b8491 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:17.394546 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dd63bfd4-d1b3-4cfc-bfd8-7ca4318b8491 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057099 Aug 01 22:54:17.395124 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 511/1002] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:54:17 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:54:17.470822 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:17.471363 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:17.478920 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:17.479438 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:17.480630 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:17.481220 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:17.509447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Going to try to terminate instance {{(pid=124356) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:54:17.590830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-18b368ef-0742-44a2-9268-461ccc42717a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 204 len: 0 microversion: 2.1 time: 0.123853 Aug 01 22:54:17.591781 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 492/1003] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:54:17 2022] DELETE /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:54:17.600514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:17.601048 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:17.607391 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:17.607836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:17.608601 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:17.609028 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:17.760164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:54:17.768292 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c71748ba-1e5b-4912-b8eb-3af04aa2a03c tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1679 microversion: 2.1 time: 0.171972 Aug 01 22:54:17.768844 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 512/1004] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:17 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:18.790501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:18.791171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:18.798426 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:18.798878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:18.799650 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:18.800094 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:19.102149 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:54:19.111373 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7befb8b1-027a-4217-a247-708d242c2a05 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1679 microversion: 2.1 time: 0.325098 Aug 01 22:54:19.111969 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 493/1005] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:18 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:20.139081 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:20.139647 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:20.146910 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:20.147351 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:20.148114 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:20.148602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:20.297805 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:54:20.310335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9741118b-0543-4c3f-85cb-ff00e4de5564 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1679 microversion: 2.1 time: 0.175057 Aug 01 22:54:20.310969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 513/1006] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:20 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:20.938203 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-8e249f8c-ea1c-4a28-bb41-783f7ca74aa0 req-284c62f0-3634-4371-a602-8cc72677027b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f63444-8160-47ae-820d-4e2772669a50", "name": "network-vif-deleted", "tag": "fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:54:20.952617 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-8e249f8c-ea1c-4a28-bb41-783f7ca74aa0 req-284c62f0-3634-4371-a602-8cc72677027b service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:20.953198 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-8e249f8c-ea1c-4a28-bb41-783f7ca74aa0 req-284c62f0-3634-4371-a602-8cc72677027b service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:20.965983 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-8e249f8c-ea1c-4a28-bb41-783f7ca74aa0 req-284c62f0-3634-4371-a602-8cc72677027b service nova] Creating event network-vif-deleted:fed8b4e3-4ff9-478a-84c2-ccd1f22b3e05 for instance d0f63444-8160-47ae-820d-4e2772669a50 on hv-cinder-85164 Aug 01 22:54:20.974022 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-8e249f8c-ea1c-4a28-bb41-783f7ca74aa0 req-284c62f0-3634-4371-a602-8cc72677027b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133327 Aug 01 22:54:20.974449 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 494/1007] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:21.335362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:21.336633 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:21.344790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:21.345242 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:21.347171 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:21.347644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:21.389949 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:21.391299 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:21.391912 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lazy-loading 'fault' on Instance uuid d0f63444-8160-47ae-820d-4e2772669a50 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:54:21.437925 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e52fe28d54963b9450f607a5cd0ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fc0c1edc794389a289555d518bfcbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:54:21.447179 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-37547a18-3a0a-4807-806d-08899cfbb6d3 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 200 len: 1330 microversion: 2.1 time: 0.115621 Aug 01 22:54:21.447967 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 514/1008] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:21 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:22.469881 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:22.470572 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:22.477265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:22.477707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:22.478505 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:22.478915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:22.493524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 HTTP/1.1 Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:22.495357 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:22.497030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'd0f63444-8160-47ae-820d-4e2772669a50'} Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:22.498035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:22.499656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:22.501060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:22.501060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-88ef50ca-35ee-453a-9c2d-72cfcc603186 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 404 len: 111 microversion: 2.1 time: 0.032065 Aug 01 22:54:22.501060 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 495/1009] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:22 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:22.510218 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b4eae9d6-dbfb-45a4-93b9-560df550ab59 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '.version_select at 0x7fc5419b93a0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:22.531177 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b4eae9d6-dbfb-45a4-93b9-560df550ab59 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476814707" status: 202 len: 0 microversion: 2.1 time: 0.024904 Aug 01 22:54:22.531746 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 515/1010] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 1 22:54:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476814707 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:54:24.617058 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:24.617662 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:24.624463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:24.624913 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:24.625712 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:24.626156 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:24.639641 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 HTTP/1.1 Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:24.641187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.642810 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'd0f63444-8160-47ae-820d-4e2772669a50'} Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:24.644134 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.645631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.647576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:24.647576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8b23a7c8-e028-4a62-9626-97d8a2a4d5da tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 404 len: 111 microversion: 2.1 time: 0.029541 Aug 01 22:54:24.647576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 496/1011] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:54:24 2022] DELETE /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:24.651752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:24.652363 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: d0f63444-8160-47ae-820d-4e2772669a50] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:24.659252 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:24.659700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:24.660426 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:24.660887 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:24.673948 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 HTTP/1.1 Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:54:24.675589 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.677160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'd0f63444-8160-47ae-820d-4e2772669a50'} Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:24.678101 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. Aug 01 22:54:24.679644 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:24.681106 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance d0f63444-8160-47ae-820d-4e2772669a50 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:24.681106 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a8330fa4-ffc7-4d57-a50f-6ea92246e039 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50" status: 404 len: 111 microversion: 2.1 time: 0.029645 Aug 01 22:54:24.681106 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 516/1012] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:24 2022] GET /compute/v2.1/servers/d0f63444-8160-47ae-820d-4e2772669a50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:25.832642 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:25.833165 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:25.840144 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.840567 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.841346 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.841819 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.857101 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 HTTP/1.1 Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:25.858709 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.860355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '0f07e887-93a3-4db1-9c93-a42ba85f6f62'} Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:25.864352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.865882 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.867427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:25.867427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-99d5a052-9c55-4ae4-bd74-1875c7442bf1 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 404 len: 111 microversion: 2.1 time: 0.031475 Aug 01 22:54:25.867427 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 497/1013] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:54:25 2022] DELETE /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:25.869924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:25.870535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: 0f07e887-93a3-4db1-9c93-a42ba85f6f62] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:25.877354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.877842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.878606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.879031 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.893582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 HTTP/1.1 Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:54:25.895239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.897208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '0f07e887-93a3-4db1-9c93-a42ba85f6f62'} Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:25.898289 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. Aug 01 22:54:25.899777 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.901142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance 0f07e887-93a3-4db1-9c93-a42ba85f6f62 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:25.901142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b26dc45c-5037-4aca-8fc9-c348abc9592a tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62" status: 404 len: 111 microversion: 2.1 time: 0.031249 Aug 01 22:54:25.901142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 517/1014] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:25 2022] GET /compute/v2.1/servers/0f07e887-93a3-4db1-9c93-a42ba85f6f62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:25.906558 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:25.907048 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:25.913352 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.913830 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.914581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.915044 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.928885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd HTTP/1.1 Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:25.930469 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.931961 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'ac705013-d650-48da-afca-8b68f18ca0fd'} Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:25.932817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.934358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.935811 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:25.935811 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0c685261-314e-477c-8cd5-191699082125 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 404 len: 111 microversion: 2.1 time: 0.029415 Aug 01 22:54:25.935811 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 498/1015] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:54:25 2022] DELETE /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:25.940691 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:25.941294 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: ac705013-d650-48da-afca-8b68f18ca0fd] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:25.947733 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.948178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.948932 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:25.949371 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:25.963232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd HTTP/1.1 Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:54:25.964761 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.966381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'ac705013-d650-48da-afca-8b68f18ca0fd'} Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:25.967224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. Aug 01 22:54:25.968834 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:25.970492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance ac705013-d650-48da-afca-8b68f18ca0fd could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:25.970492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0bd4218e-36be-43d1-9295-7f0771ae78e7 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd" status: 404 len: 111 microversion: 2.1 time: 0.029402 Aug 01 22:54:25.970492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 518/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:25 2022] GET /compute/v2.1/servers/ac705013-d650-48da-afca-8b68f18ca0fd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 22:54:27.120804 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:27.121383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:27.128346 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:27.128794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:27.129589 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:27.130087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:27.144025 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de HTTP/1.1 Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:27.145626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.147307 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'bd51e566-5acc-4ac9-8cd0-b9b84e8657de'} Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:27.148387 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.150626 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.152086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:27.152086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-20cca9c8-90f9-4a55-9c57-92bb3042a9f6 tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 404 len: 111 microversion: 2.1 time: 0.030148 Aug 01 22:54:27.152086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 499/1017] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:54:27 2022] DELETE /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:27.156014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:27.156673 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] [instance: bd51e566-5acc-4ac9-8cd0-b9b84e8657de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:54:27.163468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:27.163965 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:27.164730 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:54:27.165195 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:54:27.182925 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] HTTP exception thrown: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Request method failure captured: Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de HTTP/1.1 Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FiNNvEaVgO0gHKb_KU5lL96qBXwhzS6lsr-dIX6CITGsnRvtStdef952oCIR3RDPMV0LX8HKVqZEUBOWuEJ8WAk_W4mrX6vvhtAcmr21Qm-lCuRUCSpW1P_6zP4Bu4wPh479G2cBXsAPDqkunVqpbR1RZ50j14xn4n_D34--g1CPBM Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:54:27.184460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_01fc0c1edc794389a289555d518bfcbb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/01fc0c1edc794389a289555d518bfcbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 01fc0c1edc794389a289555d518bfcbb Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1358345052 Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 578e52fe28d54963b9450f607a5cd0ab Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-1358345052-project Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.186096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': 'bd51e566-5acc-4ac9-8cd0-b9b84e8657de'} Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:27.186969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. Aug 01 22:54:27.188260 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:27.189522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] Returning 404 to user: Instance bd51e566-5acc-4ac9-8cd0-b9b84e8657de could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:27.189522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b123c1f3-a58f-4ead-890d-34b3ff01b56f tempest-AttachVolumeNegativeTest-1358345052 tempest-AttachVolumeNegativeTest-1358345052-project] 10.222.0.47 "GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de" status: 404 len: 111 microversion: 2.1 time: 0.033758 Aug 01 22:54:27.189522 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 519/1018] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:54:27 2022] GET /compute/v2.1/servers/bd51e566-5acc-4ac9-8cd0-b9b84e8657de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:33.132802 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a3e5a2b7-cec5-4188-94fe-10ea2d5c3df9 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc542535790>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:33.183679 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a3e5a2b7-cec5-4188-94fe-10ea2d5c3df9 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/987857de-154f-4ff6-a142-07e96a45789e" status: 200 len: 351 microversion: 2.1 time: 0.054866 Aug 01 22:54:33.184248 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 500/1019] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:54:33 2022] GET /compute/v2.1/os-volumes/987857de-154f-4ff6-a142-07e96a45789e => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:34.571359 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-48bb4e81-888f-4d37-8587-6b47bb9efb69 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc5417eeaf0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:34.621231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-48bb4e81-888f-4d37-8587-6b47bb9efb69 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/5c054461-a6d4-4828-957e-60cbeb049761" status: 200 len: 349 microversion: 2.1 time: 0.065401 Aug 01 22:54:34.621839 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 520/1020] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:54:34 2022] GET /compute/v2.1/os-volumes/5c054461-a6d4-4828-957e-60cbeb049761 => generated 349 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:35.965985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e3e20b66-24c9-48b6-a49c-f357987db421 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc54184bb80>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.019976 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e3e20b66-24c9-48b6-a49c-f357987db421 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/95fb4cb7-72da-471a-8340-df88fcc59317" status: 200 len: 351 microversion: 2.1 time: 0.058376 Aug 01 22:54:36.020562 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 501/1021] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:54:35 2022] GET /compute/v2.1/os-volumes/95fb4cb7-72da-471a-8340-df88fcc59317 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:36.033932 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b334d35e-0cb9-4596-b978-08f99310e3bd tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc5419344c0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.118826 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b334d35e-0cb9-4596-b978-08f99310e3bd tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088734 Aug 01 22:54:36.119734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 521/1022] 10.222.0.47 () {58 vars in 1134 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:36.140647 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-73155b42-a19d-4abb-8eeb-309b5bd60dc8 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc541898430>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.229758 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-73155b42-a19d-4abb-8eeb-309b5bd60dc8 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095454 Aug 01 22:54:36.230319 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 502/1023] 10.222.0.47 () {58 vars in 1149 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:36.246560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d4d76aa8-7541-441c-8110-a73a72c38b3b tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc541934160>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.338676 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d4d76aa8-7541-441c-8110-a73a72c38b3b tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098614 Aug 01 22:54:36.339247 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 522/1024] 10.222.0.47 () {58 vars in 1134 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:36.355049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2565e00f-65d2-4426-bf81-c340d66ad3f3 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc541744160>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.446448 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2565e00f-65d2-4426-bf81-c340d66ad3f3 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.097498 Aug 01 22:54:36.447009 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 503/1025] 10.222.0.47 () {58 vars in 1167 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:36.460618 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5ec35f44-1b19-4f3e-8db8-40c881949b30 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc5417eec10>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.542900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5ec35f44-1b19-4f3e-8db8-40c881949b30 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085702 Aug 01 22:54:36.543702 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 523/1026] 10.222.0.47 () {58 vars in 1170 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:36.560707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-55ed165b-5452-4b7c-b818-d9e3c7e0bed3 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc541898550>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.645716 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-55ed165b-5452-4b7c-b818-d9e3c7e0bed3 tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088747 Aug 01 22:54:36.646296 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 504/1027] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:36.659196 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4567c20d-90f8-4c40-9f46-1f824bcc088d tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc5419f51f0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.746395 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4567c20d-90f8-4c40-9f46-1f824bcc088d tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.090943 Aug 01 22:54:36.746973 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 524/1028] 10.222.0.47 () {58 vars in 1188 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:54:36.761194 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-68dd41ad-d259-4bc9-85ab-0026f497b92d tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] Calling method '.version_select at 0x7fc54188d9d0>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:36.846538 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-68dd41ad-d259-4bc9-85ab-0026f497b92d tempest-VolumesTestJSON-788942444 tempest-VolumesTestJSON-788942444-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089955 Aug 01 22:54:36.847119 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 505/1029] 10.222.0.47 () {58 vars in 1155 bytes} [Mon Aug 1 22:54:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:54:41.704341 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:41.705102 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:41.824631 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fde4b44d-866d-4468-ad2d-838886c15b38 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Action: 'create', calling method: .version_select at 0x7fc5419b9e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1023302470", "metadata": {"Type": "work"}}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fde4b44d-866d-4468-ad2d-838886c15b38 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Request method failure captured: Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 122 Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FmxSws7Bid9VJTX-39qWDMrKqOZ0-S-j72QR-KjSShbMUd-ALNEOw_NaXoQ-Vxwvm3DiC1VpdGweGQ3McD1s2n-AxigbtSUTq3DXTeZDmmMlcahobkyoCmCBkciIqPxIuaS5itVk8aKZBte_3eHCrHBGRhv3renR_3Xu76Hl1B17-c Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:54:41.834103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_649bab48321e4b06af511ec45cad5abe", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 029eb16091774e94bfc8ea2c8994b90b Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1023302470", "metadata": {"Type": "work"}}} Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: Aug 01 22:54:41.835756 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1023302470', 'metadata': {'Type': 'work'}}}} Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise error Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:41.836828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 22:54:41.838614 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 22:54:41.840565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 22:54:41.840565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.840565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fde4b44d-866d-4468-ad2d-838886c15b38 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:41.840565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fde4b44d-866d-4468-ad2d-838886c15b38 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132483 Aug 01 22:54:41.840565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 525/1030] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 1 22:54:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:54:41.842667 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:41.843406 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:54:41.849050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7727846a-58dd-4bce-97f4-782e2ff581a7 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Action: 'create', calling method: .version_select at 0x7fc541848d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1362507043", "metadata": {"Type": "work"}}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7727846a-58dd-4bce-97f4-782e2ff581a7 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Request method failure captured: Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 120 Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FmxSws7Bid9VJTX-39qWDMrKqOZ0-S-j72QR-KjSShbMUd-ALNEOw_NaXoQ-Vxwvm3DiC1VpdGweGQ3McD1s2n-AxigbtSUTq3DXTeZDmmMlcahobkyoCmCBkciIqPxIuaS5itVk8aKZBte_3eHCrHBGRhv3renR_3Xu76Hl1B17-c Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:41.853693 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_649bab48321e4b06af511ec45cad5abe", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 029eb16091774e94bfc8ea2c8994b90b Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1362507043", "metadata": {"Type": "work"}}} Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: Aug 01 22:54:41.855322 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1362507043', 'metadata': {'Type': 'work'}}}} Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise error Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi '0' Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:41.856221 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 22:54:41.857704 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 22:54:41.858879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 22:54:41.858879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.858879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7727846a-58dd-4bce-97f4-782e2ff581a7 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:41.858879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7727846a-58dd-4bce-97f4-782e2ff581a7 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013690 Aug 01 22:54:41.858879 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 506/1031] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 1 22:54:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:54:41.864874 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f4c7ece4-1c0e-4483-b42d-14e7bf65ba54 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Action: 'create', calling method: .version_select at 0x7fc5419344c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1006096197", "metadata": {"Type": "work"}}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f4c7ece4-1c0e-4483-b42d-14e7bf65ba54 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Request method failure captured: Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 119 Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FmxSws7Bid9VJTX-39qWDMrKqOZ0-S-j72QR-KjSShbMUd-ALNEOw_NaXoQ-Vxwvm3DiC1VpdGweGQ3McD1s2n-AxigbtSUTq3DXTeZDmmMlcahobkyoCmCBkciIqPxIuaS5itVk8aKZBte_3eHCrHBGRhv3renR_3Xu76Hl1B17-c Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:54:41.868504 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_649bab48321e4b06af511ec45cad5abe", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 029eb16091774e94bfc8ea2c8994b90b Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1006096197", "metadata": {"Type": "work"}}} Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: Aug 01 22:54:41.870019 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1006096197', 'metadata': {'Type': 'work'}}}} Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise error Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi '' Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:41.871256 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 22:54:41.873186 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 22:54:41.874853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 22:54:41.874853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.874853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f4c7ece4-1c0e-4483-b42d-14e7bf65ba54 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:41.874853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f4c7ece4-1c0e-4483-b42d-14e7bf65ba54 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008820 Aug 01 22:54:41.874853 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 526/1032] 10.222.0.47 () {60 vars in 1156 bytes} [Mon Aug 1 22:54:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 22:54:41.881870 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-dd15b26c-bcea-4414-8af0-1c9385ebbd49 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Calling method '.version_select at 0x7fc54188d670>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:41.911994 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-dd15b26c-bcea-4414-8af0-1c9385ebbd49 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] HTTP exception thrown: Volume tempest-invalid-1904483593 could not be found. Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-dd15b26c-bcea-4414-8af0-1c9385ebbd49 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Request method failure captured: Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1904483593 HTTP/1.1 Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FmxSws7Bid9VJTX-39qWDMrKqOZ0-S-j72QR-KjSShbMUd-ALNEOw_NaXoQ-Vxwvm3DiC1VpdGweGQ3McD1s2n-AxigbtSUTq3DXTeZDmmMlcahobkyoCmCBkciIqPxIuaS5itVk8aKZBte_3eHCrHBGRhv3renR_3Xu76Hl1B17-c Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:41.914015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_649bab48321e4b06af511ec45cad5abe", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 029eb16091774e94bfc8ea2c8994b90b Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Volume tempest-invalid-1904483593 could not be found. Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': 'tempest-invalid-1904483593'} Aug 01 22:54:41.915705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1904483593 could not be found. (HTTP 404) (Request-ID: req-741f296c-92eb-4975-b6bc-fc90d1164fa7) Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.916611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 22:54:41.917885 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1904483593 could not be found. Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:41.919097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1904483593 could not be found. Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1904483593 could not be found. Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-dd15b26c-bcea-4414-8af0-1c9385ebbd49 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Returning 404 to user: Volume tempest-invalid-1904483593 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-dd15b26c-bcea-4414-8af0-1c9385ebbd49 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1904483593" status: 404 len: 99 microversion: 2.1 time: 0.040421 Aug 01 22:54:41.920349 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 507/1033] 10.222.0.47 () {58 vars in 1218 bytes} [Mon Aug 1 22:54:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1904483593 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 22:54:41.926176 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-212a8e2a-c82d-4804-8410-122d2d383027 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003778 Aug 01 22:54:41.926671 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 527/1034] 10.222.0.47 () {58 vars in 1140 bytes} [Mon Aug 1 22:54:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 22:54:41.935023 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-61e62cad-0b82-42c3-94fa-04aba0d554c8 tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003731 Aug 01 22:54:41.935516 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 508/1035] 10.222.0.47 () {58 vars in 1137 bytes} [Mon Aug 1 22:54:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 22:54:41.943930 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f4b0fb87-dfc9-4a02-b50a-0104cdeb88cd tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Calling method '.version_select at 0x7fc541820f70>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:41.972598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-f4b0fb87-dfc9-4a02-b50a-0104cdeb88cd tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] HTTP exception thrown: Volume 11404c65-7553-44db-bd3c-15abdc3a1f67 could not be found. Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f4b0fb87-dfc9-4a02-b50a-0104cdeb88cd tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Request method failure captured: Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/os-volumes/11404c65-7553-44db-bd3c-15abdc3a1f67 HTTP/1.1 Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FmxSws7Bid9VJTX-39qWDMrKqOZ0-S-j72QR-KjSShbMUd-ALNEOw_NaXoQ-Vxwvm3DiC1VpdGweGQ3McD1s2n-AxigbtSUTq3DXTeZDmmMlcahobkyoCmCBkciIqPxIuaS5itVk8aKZBte_3eHCrHBGRhv3renR_3Xu76Hl1B17-c Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:54:41.974560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_649bab48321e4b06af511ec45cad5abe", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 029eb16091774e94bfc8ea2c8994b90b Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Volume 11404c65-7553-44db-bd3c-15abdc3a1f67 could not be found. Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '11404c65-7553-44db-bd3c-15abdc3a1f67'} Aug 01 22:54:41.976249 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11404c65-7553-44db-bd3c-15abdc3a1f67 could not be found. (HTTP 404) (Request-ID: req-dc774bf3-78cc-49e4-92d4-535e466c79cc) Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.977582 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 22:54:41.979208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11404c65-7553-44db-bd3c-15abdc3a1f67 could not be found. Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 22:54:41.980873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11404c65-7553-44db-bd3c-15abdc3a1f67 could not be found. Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11404c65-7553-44db-bd3c-15abdc3a1f67 could not be found. Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f4b0fb87-dfc9-4a02-b50a-0104cdeb88cd tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Returning 404 to user: Volume 11404c65-7553-44db-bd3c-15abdc3a1f67 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f4b0fb87-dfc9-4a02-b50a-0104cdeb88cd tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/11404c65-7553-44db-bd3c-15abdc3a1f67" status: 404 len: 109 microversion: 2.1 time: 0.035594 Aug 01 22:54:41.982433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 528/1036] 10.222.0.47 () {58 vars in 1248 bytes} [Mon Aug 1 22:54:41 2022] DELETE /compute/v2.1/os-volumes/11404c65-7553-44db-bd3c-15abdc3a1f67 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:54:41.987445 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9c8211ba-ef9a-47c8-973f-56f9a9a6535f tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Calling method '.version_select at 0x7fc541766d30>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:54:42.020676 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-9c8211ba-ef9a-47c8-973f-56f9a9a6535f tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] HTTP exception thrown: Volume 27b0521a-83a6-4ca0-8658-e9f5fe7922ca could not be found. Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9c8211ba-ef9a-47c8-973f-56f9a9a6535f tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Request method failure captured: Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/os-volumes/27b0521a-83a6-4ca0-8658-e9f5fe7922ca HTTP/1.1 Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FmxSws7Bid9VJTX-39qWDMrKqOZ0-S-j72QR-KjSShbMUd-ALNEOw_NaXoQ-Vxwvm3DiC1VpdGweGQ3McD1s2n-AxigbtSUTq3DXTeZDmmMlcahobkyoCmCBkciIqPxIuaS5itVk8aKZBte_3eHCrHBGRhv3renR_3Xu76Hl1B17-c Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:54:42.022766 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_649bab48321e4b06af511ec45cad5abe", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/649bab48321e4b06af511ec45cad5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 649bab48321e4b06af511ec45cad5abe Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-VolumesNegativeTest-1567053392 Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 029eb16091774e94bfc8ea2c8994b90b Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-VolumesNegativeTest-1567053392-project Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Volume 27b0521a-83a6-4ca0-8658-e9f5fe7922ca could not be found. Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '27b0521a-83a6-4ca0-8658-e9f5fe7922ca'} Aug 01 22:54:42.024451 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27b0521a-83a6-4ca0-8658-e9f5fe7922ca could not be found. (HTTP 404) (Request-ID: req-cd76084c-f8c8-48dc-98c0-7d102dce5cd8) Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:42.025638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 22:54:42.027103 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27b0521a-83a6-4ca0-8658-e9f5fe7922ca could not be found. Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 22:54:42.028636 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27b0521a-83a6-4ca0-8658-e9f5fe7922ca could not be found. Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27b0521a-83a6-4ca0-8658-e9f5fe7922ca could not be found. Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9c8211ba-ef9a-47c8-973f-56f9a9a6535f tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] Returning 404 to user: Volume 27b0521a-83a6-4ca0-8658-e9f5fe7922ca could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9c8211ba-ef9a-47c8-973f-56f9a9a6535f tempest-VolumesNegativeTest-1567053392 tempest-VolumesNegativeTest-1567053392-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/27b0521a-83a6-4ca0-8658-e9f5fe7922ca" status: 404 len: 109 microversion: 2.1 time: 0.042115 Aug 01 22:54:42.030092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 509/1037] 10.222.0.47 () {58 vars in 1245 bytes} [Mon Aug 1 22:54:41 2022] GET /compute/v2.1/os-volumes/27b0521a-83a6-4ca0-8658-e9f5fe7922ca => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:55:06.121344 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:06.122234 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:06.129685 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:06.130125 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:06.130890 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:06.131315 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:06.156835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:55:06.237253 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-adbf3805-0d4f-4467-bda9-c80a8e56ba20 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "DELETE /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 204 len: 0 microversion: 2.1 time: 0.122734 Aug 01 22:55:06.237921 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 529/1038] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:55:06 2022] DELETE /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:55:06.249215 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:06.249863 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:06.256187 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:06.256633 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:06.257395 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:06.257859 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:06.397956 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:06.406308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-96b2df37-1668-4f9f-a9c3-e37b3062644b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1574 microversion: 2.1 time: 0.162460 Aug 01 22:55:06.407157 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 510/1039] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:06 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:07.429290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:07.430039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:07.437039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:07.437486 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:07.438301 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:07.438731 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:07.583795 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:07.592043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fca50658-5a10-4fcc-a4f2-9aa5be9b15a5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1574 microversion: 2.1 time: 0.167095 Aug 01 22:55:07.592615 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 530/1040] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:07 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:08.613996 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:08.614631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:08.622047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:08.622618 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:08.623405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:08.623850 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:08.785745 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:08.794150 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8a6b7b26-12e0-47ec-b809-f008ae6bb6d3 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1574 microversion: 2.1 time: 0.184160 Aug 01 22:55:08.794944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 511/1041] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:08 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:09.817478 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:09.818180 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:09.827231 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:09.827970 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:09.829238 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:09.829968 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:10.036920 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:10.046585 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c590a786-26f7-40b9-9068-ac70cc012449 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1574 microversion: 2.1 time: 0.233445 Aug 01 22:55:10.047509 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 531/1042] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:09 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1574 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:11.072886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:11.073527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:11.080684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:11.081155 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:11.081945 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:11.082377 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:11.184270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:11.192116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-30b83452-44e5-4f94-ac63-0c1a5b19b10b tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 200 len: 1506 microversion: 2.1 time: 0.123335 Aug 01 22:55:11.192684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 512/1043] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:11 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 1506 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:11.301341 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-576d0bb3-2ea3-4d5a-83a9-11357fbbb086 req-e72aea65-4bfd-4948-a030-6d1113bc7903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513fe11b-f879-4c6f-81fa-6f9747182d90", "name": "network-vif-deleted", "tag": "62cfa26a-1ad8-4c12-8bcd-ec04761c6203"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:11.316196 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-576d0bb3-2ea3-4d5a-83a9-11357fbbb086 req-e72aea65-4bfd-4948-a030-6d1113bc7903 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:11.316915 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-576d0bb3-2ea3-4d5a-83a9-11357fbbb086 req-e72aea65-4bfd-4948-a030-6d1113bc7903 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:11.330585 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-576d0bb3-2ea3-4d5a-83a9-11357fbbb086 req-e72aea65-4bfd-4948-a030-6d1113bc7903 service nova] Creating event network-vif-deleted:62cfa26a-1ad8-4c12-8bcd-ec04761c6203 for instance 513fe11b-f879-4c6f-81fa-6f9747182d90 on hv-cinder-85164 Aug 01 22:55:11.336605 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-576d0bb3-2ea3-4d5a-83a9-11357fbbb086 req-e72aea65-4bfd-4948-a030-6d1113bc7903 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040782 Aug 01 22:55:11.337670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 532/1044] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:55:12.217266 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:12.217965 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:12.225319 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:12.225787 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:12.226603 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:12.227035 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:12.243757 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] HTTP exception thrown: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Request method failure captured: Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 HTTP/1.1 Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fks-t5UYtglEiOLKCwO87djTu96AvqoNVoAJwdWt2MfxSegR0PGfvsLz7IclOokTUXexh91fuhqlrXR5xCk82vHVyXZ5d_HBb_OkK6Mgy_H33XRdD62Ss3nwNnUG6lE16KsZZJrEOKg6OLA449PudexpCs4JQexc5w8D08uIyT5iFY Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:55:12.245300 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8b83b190c95f4ed8901f10c9fc67b365", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-TestVolumeBootPattern-438672709 Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 4bba292314fd415f94fb537237d9d898 Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:55:12.246825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '513fe11b-f879-4c6f-81fa-6f9747182d90'} Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:55:12.248254 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:55:12.250214 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:55:12.251600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Returning 404 to user: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:55:12.251600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-beeee290-92c6-4472-b103-49d4b5c3a6a6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 404 len: 111 microversion: 2.1 time: 0.036503 Aug 01 22:55:12.251600 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 513/1045] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:12 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:55:12.364123 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-226491853", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-525941748", "security_groups": [{"name": "tempest-secgroup-smoke-2143579186"}], "block_device_mapping_v2": [{"uuid": "fc6d2aa9-c456-47c1-a000-813e6f5ae208", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ee40167-a18f-4159-bd79-1cfac2235d6d"}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:12.492975 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] validate_networks() for [('0ee40167-a18f-4159-bd79-1cfac2235d6d', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:55:13.039324 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:55:13.039828 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:55:13.040302 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:55:13.040700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:55:13.041103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:55:13.052017 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:13.052486 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:13.053278 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:13.053754 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:13.073903 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:55:13.078940 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for user 4bba292314fd415f94fb537237d9d898 and project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:55:13.144748 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:55:13.146964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc6d2aa9-c456-47c1-a000-813e6f5ae208',volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:55:13.291184 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-398605d7-4885-4071-9990-521d8f51d1bb tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.931893 Aug 01 22:55:13.291749 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 533/1046] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:55:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:55:13.303870 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6c090038-cd73-4db3-bd50-b8fc5d8b1183 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:13.305638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6c090038-cd73-4db3-bd50-b8fc5d8b1183 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:13.368211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6c090038-cd73-4db3-bd50-b8fc5d8b1183 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:13.375621 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6c090038-cd73-4db3-bd50-b8fc5d8b1183 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1093 microversion: 2.1 time: 0.075718 Aug 01 22:55:13.376388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 514/1047] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:13 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:55:14.402168 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:14.402791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:14.410774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:14.411032 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:14.411895 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:14.412625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:14.491163 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:14.499518 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cf182090-e5c0-4339-9016-e74c63913195 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1143 microversion: 2.1 time: 0.101733 Aug 01 22:55:14.500105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 534/1048] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:14 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1143 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:15.520708 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:15.521960 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:15.531276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:15.531736 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:15.532556 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:15.533113 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:15.603048 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:15.615548 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8746ebe2-0278-45c5-b2b1-d9e49b1696d5 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1135 microversion: 2.1 time: 0.098720 Aug 01 22:55:15.616615 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 515/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:15 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1135 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:16.642375 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:16.643865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:16.651991 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:16.652633 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:16.653792 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:16.654385 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:16.738998 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:16.754365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-79fd0db7-d584-4e9c-8fb0-fc58ccc06213 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1209 microversion: 2.1 time: 0.117823 Aug 01 22:55:16.770120 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 535/1050] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:16 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:17.506886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-4ce71bed-54c8-476f-9589-66d88450b9f2 req-6b0168c9-a52f-44b8-872b-57b97df6cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc28627-645c-4fd2-aea0-55ad51a5ebda", "tag": "7bc46797-5668-4b8f-8988-48f3cf5e2499"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:17.519413 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-4ce71bed-54c8-476f-9589-66d88450b9f2 req-6b0168c9-a52f-44b8-872b-57b97df6cd21 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:17.519863 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-4ce71bed-54c8-476f-9589-66d88450b9f2 req-6b0168c9-a52f-44b8-872b-57b97df6cd21 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:17.533656 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-4ce71bed-54c8-476f-9589-66d88450b9f2 req-6b0168c9-a52f-44b8-872b-57b97df6cd21 service nova] Creating event network-changed:7bc46797-5668-4b8f-8988-48f3cf5e2499 for instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda on hv-cinder-85164 Aug 01 22:55:17.539013 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-4ce71bed-54c8-476f-9589-66d88450b9f2 req-6b0168c9-a52f-44b8-872b-57b97df6cd21 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036031 Aug 01 22:55:17.539629 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 516/1051] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:55:17.793105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:17.794527 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:17.805670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:17.806381 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:17.807436 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:17.808043 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:17.963070 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:17.973716 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ac87224b-35c6-45e6-a9a3-444b2e62420d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.188507 Aug 01 22:55:17.974313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 536/1052] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:17 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:18.999288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:19.000019 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:19.007252 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:19.007703 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:19.008477 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:19.008918 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:19.145084 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:19.156721 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9440d114-6a74-40d8-92c7-2d42923cee24 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.163893 Aug 01 22:55:19.157291 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 517/1053] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:18 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:20.178710 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:20.179428 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:20.187035 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:20.187476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:20.188281 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:20.188706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:20.341394 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:20.350159 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-699916a7-270c-4e8c-8ede-b73b5cd94448 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.175862 Aug 01 22:55:20.350724 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 537/1054] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:20 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:21.371658 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:21.373301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:21.381016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:21.381583 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:21.382484 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:21.382999 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:21.531355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:21.539944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-09dcc76f-4b38-4fa9-ad0c-a54ed4de1576 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.172189 Aug 01 22:55:21.540544 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 518/1055] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:21 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:22.561303 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:22.562830 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:22.570081 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:22.570639 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:22.571558 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:22.572294 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:22.722971 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:22.732706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f05475c7-fd18-44b2-8894-638c4a4534d6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.175195 Aug 01 22:55:22.733468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 538/1056] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:22 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:23.755845 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:23.757255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:23.766890 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:23.769991 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:23.770868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:23.771835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:23.772793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:23.960167 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:23.969594 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-9c4c35c7-c6fc-4551-b5cc-a1a3e306f8c6 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.217780 Aug 01 22:55:23.971021 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 519/1057] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:23 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:24.993607 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:24.994374 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:24.996665 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:24.997749 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:25.007317 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:25.007913 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:25.008700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:25.009131 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:25.227694 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:25.237669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e1d490fe-8741-4a83-8755-02aef52587f4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.249254 Aug 01 22:55:25.238476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 539/1058] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:24 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:26.265326 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:26.266308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:26.274612 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:26.275065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:26.276301 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:26.277088 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:26.518896 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:26.527545 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2378c674-616f-4bac-b834-dd3278032eae tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.266246 Aug 01 22:55:26.535056 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 520/1059] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:26 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:27.482774 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-1c9c7922-e46a-4e01-a8fc-3a507bd35451 req-4b5ca168-74cc-4827-a515-0066261e96d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc28627-645c-4fd2-aea0-55ad51a5ebda", "name": "network-vif-plugged", "status": "completed", "tag": "7bc46797-5668-4b8f-8988-48f3cf5e2499"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:27.492875 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-1c9c7922-e46a-4e01-a8fc-3a507bd35451 req-4b5ca168-74cc-4827-a515-0066261e96d2 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:27.493314 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-1c9c7922-e46a-4e01-a8fc-3a507bd35451 req-4b5ca168-74cc-4827-a515-0066261e96d2 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:27.505909 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-1c9c7922-e46a-4e01-a8fc-3a507bd35451 req-4b5ca168-74cc-4827-a515-0066261e96d2 service nova] Creating event network-vif-plugged:7bc46797-5668-4b8f-8988-48f3cf5e2499 for instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda on hv-cinder-85164 Aug 01 22:55:27.511394 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-1c9c7922-e46a-4e01-a8fc-3a507bd35451 req-4b5ca168-74cc-4827-a515-0066261e96d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240139 Aug 01 22:55:27.512014 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 540/1060] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:55:27.554718 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:27.557045 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:27.564417 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:27.565025 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:27.565955 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:27.566581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:27.738741 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:27.749930 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a2a6ad69-b851-4175-b604-5842bad99b66 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.204256 Aug 01 22:55:27.750726 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 521/1061] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:27 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:28.784503 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:28.786491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:28.795524 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:28.796266 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:28.797447 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:28.798229 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:28.994107 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:29.009425 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-87ec99ab-8081-4ac1-9c8c-c57317f0040e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1265 microversion: 2.1 time: 0.231546 Aug 01 22:55:29.018981 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 541/1062] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:28 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:30.032620 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:30.033206 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:30.041908 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:30.042832 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:30.044435 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:30.045246 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:30.319691 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:30.329496 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a55663b2-cd5d-4bcb-aba5-9b558cf14a42 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1450 microversion: 2.1 time: 0.300951 Aug 01 22:55:30.331410 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 522/1063] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:30 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1450 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:30.351448 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:30.352080 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:30.358746 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:30.359179 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:30.360407 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:30.360856 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:30.526847 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:30.538791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-78bfb8fd-6d82-4d31-803e-beac11ec7e4e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1450 microversion: 2.1 time: 0.191213 Aug 01 22:55:30.539382 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 542/1064] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:30 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1450 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:33.777032 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-50844a88-2f7f-4315-b3b0-13b26984619f req-c783c4f4-67b8-4ea9-a5f7-4761daafa5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc28627-645c-4fd2-aea0-55ad51a5ebda", "tag": "7bc46797-5668-4b8f-8988-48f3cf5e2499"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:33.793478 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-50844a88-2f7f-4315-b3b0-13b26984619f req-c783c4f4-67b8-4ea9-a5f7-4761daafa5c0 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:33.793957 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-50844a88-2f7f-4315-b3b0-13b26984619f req-c783c4f4-67b8-4ea9-a5f7-4761daafa5c0 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:33.807095 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-50844a88-2f7f-4315-b3b0-13b26984619f req-c783c4f4-67b8-4ea9-a5f7-4761daafa5c0 service nova] Creating event network-changed:7bc46797-5668-4b8f-8988-48f3cf5e2499 for instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda on hv-cinder-85164 Aug 01 22:55:33.813348 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-50844a88-2f7f-4315-b3b0-13b26984619f req-c783c4f4-67b8-4ea9-a5f7-4761daafa5c0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282178 Aug 01 22:55:33.814281 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 523/1065] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:55:43.630457 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4ef64cc8-8087-47d8-befa-42a9bacfa315 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Action: 'create', calling method: .version_select at 0x7fc5419173a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-952599752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHprhndAq4yC2hcryx3IkI4HSECZUUGbsorX2G4EUyKBg4WZgTXHD6YfUxoS36AkffEKIKNrB+jMADKDyZa4SLTv5/SEgop68NqZ6nn7RLdUkfOH2OysOlc2yUVYBNYx/A=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:43.636189 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:43.636808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:43.656586 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-4ef64cc8-8087-47d8-befa-42a9bacfa315 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Getting quotas for project 243a702bf7464281a76960b63e849b76. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:55:43.660641 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-4ef64cc8-8087-47d8-befa-42a9bacfa315 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Getting quotas for user 5ff80fefdd364fc1b0a9a4c54c1e1a30 and project 243a702bf7464281a76960b63e849b76. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:55:43.686182 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4ef64cc8-8087-47d8-befa-42a9bacfa315 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059527 Aug 01 22:55:43.686775 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 543/1066] 10.222.0.47 () {60 vars in 1159 bytes} [Mon Aug 1 22:55:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:55:43.743900 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1502599987", "imageRef": "8bdf1ef0-7df8-4d32-926c-20a58f5a2ce8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-952599752", "networks": [{"uuid": "c4f4dcbc-d4ec-482a-ac9e-9ee8115428b8"}]}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:43.752792 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=31 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:43.798026 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.network.neutron [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] validate_networks() for [('c4f4dcbc-d4ec-482a-ac9e-9ee8115428b8', None, None, None, None, None)] {{(pid=124356) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:55:43.805395 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=66 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:44.314283 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Flavor limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:55:44.314751 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Image limits 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:55:44.315225 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Flavor pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:55:44.315648 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Image pref 0:0:0 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:55:44.316050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.virt.hardware [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:55:44.325094 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:44.325550 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:44.326363 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:44.326796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:44.344827 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Getting quotas for project 243a702bf7464281a76960b63e849b76. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:55:44.349147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.quota [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Getting quotas for user 5ff80fefdd364fc1b0a9a4c54c1e1a30 and project 243a702bf7464281a76960b63e849b76. Resources: {'ram', 'instances', 'cores'} {{(pid=124356) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:55:44.360761 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Going to run 1 instances... {{(pid=124356) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:55:44.363078 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8bdf1ef0-7df8-4d32-926c-20a58f5a2ce8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:55:44.409250 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-db66d665-515e-4381-a785-21a99341f806 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669993 Aug 01 22:55:44.409931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 524/1067] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:55:44.420786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-80e51171-c566-4356-bbd1-be9ad378fd15 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:44.421392 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-80e51171-c566-4356-bbd1-be9ad378fd15 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:44.478672 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-80e51171-c566-4356-bbd1-be9ad378fd15 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:44.495952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-80e51171-c566-4356-bbd1-be9ad378fd15 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1258 microversion: 2.1 time: 0.078735 Aug 01 22:55:44.497011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 544/1068] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:44 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:55:45.518101 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:45.518744 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:45.527674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:45.528378 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:45.529171 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:45.529639 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:45.634038 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:45.642102 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-8c74af48-5b1d-46eb-894f-9f5d1108698c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1328 microversion: 2.1 time: 0.128209 Aug 01 22:55:45.642672 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 525/1069] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:45 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1328 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:46.663876 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:46.665117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:46.673244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:46.673720 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:46.674494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:46.674919 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:46.827206 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:46.835304 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8e9cc810-a279-4c15-b357-495bae6a4353 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.175470 Aug 01 22:55:46.845791 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 545/1070] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:46 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:47.863643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:47.864851 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:47.874139 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:47.874700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:47.875799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:47.876354 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:48.044859 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:48.053908 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-fa18773b-e54d-4393-8c05-9178255d35d8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.197798 Aug 01 22:55:48.054648 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 526/1071] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:47 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:55:49.078115 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:49.079302 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:49.088456 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:49.089385 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:49.090257 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:49.090666 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:49.287523 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:49.295850 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3cb3d57b-5148-483e-8c7b-e8017117cf31 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.223658 Aug 01 22:55:49.296542 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 546/1072] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:49 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:50.317478 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:50.318321 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:50.326705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:50.327164 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:50.327944 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:50.328415 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:50.473108 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:50.485884 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a199c528-9318-471c-8ef1-4ed840f3ce98 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.171841 Aug 01 22:55:50.493072 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 527/1073] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:50 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:51.509345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:51.510384 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:51.517366 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:51.517937 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:51.518847 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:51.519349 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:51.691609 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:51.699178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cb616555-c852-46d7-8f3a-f4f13526e219 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.194162 Aug 01 22:55:51.699757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 547/1074] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:51 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:52.723715 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:52.724723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:52.735290 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:52.736292 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:52.737341 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:52.738128 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:52.887162 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:52.895431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2158b889-2973-477b-b473-1704575e3fd1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.176322 Aug 01 22:55:52.896023 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 528/1075] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:52 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:53.918280 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:53.919875 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:53.927784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:53.928560 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:53.929389 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:53.929870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:54.080227 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:54.091327 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3384658f-f681-4abb-b517-98ad2d7fa763 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.177113 Aug 01 22:55:54.092248 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 548/1076] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:53 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:55.114065 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:55.114797 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:55.117218 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=2 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:55.118062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=6 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:55.124272 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:55.124722 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:55.125501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:55.125970 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:55.332573 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:55.341579 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-63db3806-58d6-4733-9ac3-d2158e8bf7d3 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.231489 Aug 01 22:55:55.351284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 529/1077] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:55 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:55.619792 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-16134667-ebb0-4f09-bcfe-e78d594f336c req-65cc38ac-a8eb-42ee-a3e4-e7478d15f831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322e4a4f-9cee-46c0-bed2-eaca58198680", "tag": "5d1159a0-d46b-43dc-ab5f-e11e7c19e938"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:55:55.631275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:55:55.649573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-16134667-ebb0-4f09-bcfe-e78d594f336c req-65cc38ac-a8eb-42ee-a3e4-e7478d15f831 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:55.650429 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-16134667-ebb0-4f09-bcfe-e78d594f336c req-65cc38ac-a8eb-42ee-a3e4-e7478d15f831 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:55.662808 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-16134667-ebb0-4f09-bcfe-e78d594f336c req-65cc38ac-a8eb-42ee-a3e4-e7478d15f831 service nova] Creating event network-changed:5d1159a0-d46b-43dc-ab5f-e11e7c19e938 for instance 322e4a4f-9cee-46c0-bed2-eaca58198680 on hv-cinder-85164 Aug 01 22:55:55.668097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-16134667-ebb0-4f09-bcfe-e78d594f336c req-65cc38ac-a8eb-42ee-a3e4-e7478d15f831 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052244 Aug 01 22:55:55.668717 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 549/1078] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:55:56.363493 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:56.364076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:56.371153 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:56.371643 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:56.372425 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:56.372842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:56.522176 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:56.530422 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-d85e9645-5966-4692-921d-100715daaf13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.170897 Aug 01 22:55:56.531006 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 530/1079] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:56 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:57.553099 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:57.553936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:57.560911 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:57.561357 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:57.562170 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:57.562612 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:57.706767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:57.715034 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eff63f02-197b-45d3-b038-8f9684c7829c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.166576 Aug 01 22:55:57.715677 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 550/1080] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:57 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:55:58.737086 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:58.737716 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:58.744632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:58.745063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:58.745871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:58.746305 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:58.880974 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:55:58.889006 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a1519d25-59ea-4814-ba7e-ca4ef9f0ed28 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.155853 Aug 01 22:55:58.889588 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 531/1081] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:58 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:55:59.912047 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:55:59.912790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:55:59.922258 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:59.922705 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:55:59.923478 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:55:59.923907 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:00.056031 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:00.064107 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1c3ea4b1-ad21-4e16-b093-e9b379bd0b09 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.157492 Aug 01 22:56:00.064648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 551/1082] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:55:59 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:01.018356 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-bbf996eb-6e0f-4031-8322-29687f152410 req-e30be0b0-bc80-4c3f-91bd-2bd6fcf7b046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322e4a4f-9cee-46c0-bed2-eaca58198680", "name": "network-vif-plugged", "status": "completed", "tag": "5d1159a0-d46b-43dc-ab5f-e11e7c19e938"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:56:01.029995 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-bbf996eb-6e0f-4031-8322-29687f152410 req-e30be0b0-bc80-4c3f-91bd-2bd6fcf7b046 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:01.030522 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-bbf996eb-6e0f-4031-8322-29687f152410 req-e30be0b0-bc80-4c3f-91bd-2bd6fcf7b046 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:01.046030 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-bbf996eb-6e0f-4031-8322-29687f152410 req-e30be0b0-bc80-4c3f-91bd-2bd6fcf7b046 service nova] Creating event network-vif-plugged:5d1159a0-d46b-43dc-ab5f-e11e7c19e938 for instance 322e4a4f-9cee-46c0-bed2-eaca58198680 on hv-cinder-85164 Aug 01 22:56:01.051147 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-bbf996eb-6e0f-4031-8322-29687f152410 req-e30be0b0-bc80-4c3f-91bd-2bd6fcf7b046 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036790 Aug 01 22:56:01.051727 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 532/1083] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:56:01.084836 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:01.086552 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:01.095616 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:01.096651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:01.097984 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:01.098423 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:01.241419 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:01.249360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6733b470-6310-4bb5-9282-29d2687aa2ae tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.168620 Aug 01 22:56:01.249963 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 552/1084] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:01 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:02.270941 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:02.271713 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:02.278703 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:02.279154 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:02.279987 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:02.280813 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:02.427524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:02.435611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2e5b0c93-01ca-43b9-8253-aa5cf58e785f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1358 microversion: 2.1 time: 0.169594 Aug 01 22:56:02.436216 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 533/1085] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:02 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:03.456467 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:03.457081 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:03.464105 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:03.464571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:03.465325 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:03.465835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:03.601532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:03.609201 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6a14475c-1273-45aa-833e-78433803650c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1548 microversion: 2.1 time: 0.156713 Aug 01 22:56:03.609855 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 553/1086] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:03 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:03.630092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:03.630679 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:03.637400 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:03.637886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:03.638641 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:03.639074 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:03.766888 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:03.774878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-62949ba3-1f9d-4c12-8207-11cf604861da tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1548 microversion: 2.1 time: 0.148921 Aug 01 22:56:03.775459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 534/1087] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:03 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:56:03.794687 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:03.799412 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:03.800179 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Searching by: {'deleted': False, 'project_id': '243a702bf7464281a76960b63e849b76'} {{(pid=124358) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 22:56:03.807051 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:03.807491 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:03.808273 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:03.808704 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:03.896525 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.multi_cell_list [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124358) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 22:56:03.991571 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-355fcf7c-9653-45c1-b3bd-aa849e13362b tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200470 Aug 01 22:56:03.992053 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 554/1088] 10.222.0.47 () {58 vars in 1125 bytes} [Mon Aug 1 22:56:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:56:04.003495 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:04.004115 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:04.011204 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:04.011760 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:04.012534 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:04.012953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:04.146076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:04.153692 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-93b81ca4-6b61-4dba-9cb7-1956588ad114 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1548 microversion: 2.1 time: 0.154095 Aug 01 22:56:04.154268 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 535/1089] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:03 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:05.707878 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-37cad9b2-0c97-4f92-8820-76b2b22a7d04 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c5a9423-4149-48b4-b68b-cc7f85b3629f"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:56:05.710298 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-37cad9b2-0c97-4f92-8820-76b2b22a7d04 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:05.717243 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37cad9b2-0c97-4f92-8820-76b2b22a7d04 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:05.717726 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37cad9b2-0c97-4f92-8820-76b2b22a7d04 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:05.718495 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37cad9b2-0c97-4f92-8820-76b2b22a7d04 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:05.718923 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37cad9b2-0c97-4f92-8820-76b2b22a7d04 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:05.969013 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-37cad9b2-0c97-4f92-8820-76b2b22a7d04 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265006 Aug 01 22:56:05.970107 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 555/1090] 10.222.0.47 () {60 vars in 1323 bytes} [Mon Aug 1 22:56:05 2022] POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:56:12.711476 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:12.712077 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:12.718868 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:12.719691 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:12.720472 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:12.720934 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:12.858183 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:12.866289 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-05e04560-f0e6-4aa3-8bbd-8a3d2042249a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1594 microversion: 2.1 time: 0.158695 Aug 01 22:56:12.866874 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 536/1091] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:12 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:13.872541 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 22:56:13.873306 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Mon Aug 1 22:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 22:56:14.862017 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:56:14.866979 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-d410c99c-1d2e-4d93-8dcf-d8773091910e req-2d0c3a36-d46a-4a39-96b9-f155dab23a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322e4a4f-9cee-46c0-bed2-eaca58198680", "tag": "5d1159a0-d46b-43dc-ab5f-e11e7c19e938"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:56:14.872297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:56:14.879248 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-d410c99c-1d2e-4d93-8dcf-d8773091910e req-2d0c3a36-d46a-4a39-96b9-f155dab23a39 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:14.879833 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-d410c99c-1d2e-4d93-8dcf-d8773091910e req-2d0c3a36-d46a-4a39-96b9-f155dab23a39 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:14.885129 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:56:14.895178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-d410c99c-1d2e-4d93-8dcf-d8773091910e req-2d0c3a36-d46a-4a39-96b9-f155dab23a39 service nova] Creating event network-changed:5d1159a0-d46b-43dc-ab5f-e11e7c19e938 for instance 322e4a4f-9cee-46c0-bed2-eaca58198680 on hv-cinder-85164 Aug 01 22:56:14.901601 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-d410c99c-1d2e-4d93-8dcf-d8773091910e req-2d0c3a36-d46a-4a39-96b9-f155dab23a39 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040834 Aug 01 22:56:14.905302 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 556/1092] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:56:16.074050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-49482298"}} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:56:16.074794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:16.078092 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:56:16.082063 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:16.082517 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:16.083308 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:16.083751 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:16.086878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=71 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:56:16.235953 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.network.security_group_api [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Adding security group 9fe93b45-4e00-4109-a251-4a1c56627883 to port 5d1159a0-d46b-43dc-ab5f-e11e7c19e938 Aug 01 22:56:16.566031 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-2d45e897-eb2e-4478-be7e-9e8a2d9f0991 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/action" status: 202 len: 0 microversion: 2.1 time: 0.496030 Aug 01 22:56:16.571569 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 537/1093] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:56:16 2022] POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:56:16.580259 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-faa895e2-cea9-47c4-8277-4cdcfee60318 req-82dd98a7-466a-4426-a489-d7ee9df1c31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322e4a4f-9cee-46c0-bed2-eaca58198680", "tag": "5d1159a0-d46b-43dc-ab5f-e11e7c19e938"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:56:16.586847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:16.586847 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:16.599386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-faa895e2-cea9-47c4-8277-4cdcfee60318 req-82dd98a7-466a-4426-a489-d7ee9df1c31a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:16.601585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:16.601585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:16.602316 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:16.602755 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:16.604322 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-faa895e2-cea9-47c4-8277-4cdcfee60318 req-82dd98a7-466a-4426-a489-d7ee9df1c31a service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:16.631310 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-faa895e2-cea9-47c4-8277-4cdcfee60318 req-82dd98a7-466a-4426-a489-d7ee9df1c31a service nova] Creating event network-changed:5d1159a0-d46b-43dc-ab5f-e11e7c19e938 for instance 322e4a4f-9cee-46c0-bed2-eaca58198680 on hv-cinder-85164 Aug 01 22:56:16.641073 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-faa895e2-cea9-47c4-8277-4cdcfee60318 req-82dd98a7-466a-4426-a489-d7ee9df1c31a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069820 Aug 01 22:56:16.642103 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 557/1094] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:56:16.882611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:16.891314 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5dfc86c4-e8c0-4905-acfe-dd2438fb5a7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1758 microversion: 2.1 time: 0.314520 Aug 01 22:56:16.892064 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 538/1095] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:16 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1758 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:42.441819 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-df0cbdfc-3deb-4759-a5cd-dd407ad1970f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:56:42.444775 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-df0cbdfc-3deb-4759-a5cd-dd407ad1970f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:42.453498 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df0cbdfc-3deb-4759-a5cd-dd407ad1970f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:42.453977 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df0cbdfc-3deb-4759-a5cd-dd407ad1970f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:42.454772 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df0cbdfc-3deb-4759-a5cd-dd407ad1970f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:42.455200 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df0cbdfc-3deb-4759-a5cd-dd407ad1970f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:42.537870 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-df0cbdfc-3deb-4759-a5cd-dd407ad1970f tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/action" status: 202 len: 0 microversion: 2.1 time: 0.102390 Aug 01 22:56:42.538593 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 558/1096] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:56:42 2022] POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:56:42.547073 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:42.547694 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:42.550167 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=3 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:56:42.550898 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=9 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:56:42.563576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:42.564096 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:42.565027 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:42.565434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:42.824576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:42.832725 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-233fa05b-3125-42b0-adf8-45508b8bd1b8 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1750 microversion: 2.1 time: 0.289662 Aug 01 22:56:42.833350 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 539/1097] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:42 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1750 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:56:43.858692 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:43.859284 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:43.866242 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:43.866685 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:43.867465 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:43.867900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:44.029117 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:44.037648 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0e0015ea-f511-4f56-84a6-e383ecb67f21 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.184621 Aug 01 22:56:44.038172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 559/1098] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:43 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:45.061479 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:45.062117 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:45.069262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:45.069779 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:45.070555 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:45.071181 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:45.216576 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:45.225867 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-01ee9bfe-bd1b-4121-a0fc-49ff077eeb13 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.169606 Aug 01 22:56:45.226501 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 540/1099] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:45 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:46.248645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:46.249281 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:46.256275 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:46.256725 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:46.257487 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:46.257957 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:46.402458 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:46.410606 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-86e0b70c-31dd-4122-b862-d56865f6a163 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.166072 Aug 01 22:56:46.411210 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 560/1100] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:46 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:47.435911 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:47.436493 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:47.442973 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:47.443434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:47.444192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:47.444632 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:47.599062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:47.607684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-aa733388-d671-4515-b5ec-eb81d2ecaf6e tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.175979 Aug 01 22:56:47.608262 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 541/1101] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:47 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:48.633917 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:48.634887 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:48.646003 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:48.646752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:48.648104 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:48.648812 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:48.800018 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:48.808482 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-590d09bc-3788-4e91-864a-5a36c23c8eb7 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.181032 Aug 01 22:56:48.809048 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 561/1102] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:48 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:49.837457 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:49.838129 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:49.845589 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:49.846041 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:49.846809 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:49.847244 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:49.994265 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:50.002849 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-19e0cee0-6af6-4e77-88e2-ad32a55d59e9 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.169320 Aug 01 22:56:50.003442 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 542/1103] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:49 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:51.025508 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:51.026239 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:51.033546 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:51.034039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:51.034793 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:51.035216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:51.195144 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:51.208568 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e2f3d19b-50f4-4771-b2df-6803cca33596 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.187900 Aug 01 22:56:51.209142 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 562/1104] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:51 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:52.240919 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:52.241717 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:52.251270 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:52.251732 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:52.252500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:52.252940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:52.407985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:52.416148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-c70c2d4f-8225-4300-a671-024f541ace6d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.181522 Aug 01 22:56:52.416721 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 543/1105] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:52 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:53.437607 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:53.438164 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:53.445296 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:53.445766 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:53.446527 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:53.446958 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:53.606598 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:53.615128 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dbea5794-9910-436e-93f3-319be0d7fdaf tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1755 microversion: 2.1 time: 0.181469 Aug 01 22:56:53.615706 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 563/1106] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:53 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:56:54.638715 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:56:54.639347 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:56:54.646434 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:54.647048 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:54.647634 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:56:54.648062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:56:54.791306 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:56:54.799818 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-897f15d4-aa08-4f91-b6dc-161ba25b3c7a tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1758 microversion: 2.1 time: 0.165076 Aug 01 22:56:54.800405 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 544/1107] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:56:54 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:23.300362 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1628371701", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-525941748", "security_groups": [{"name": "tempest-secgroup-smoke-2143579186"}], "block_device_mapping_v2": [{"uuid": "5c4d00fc-3daf-4302-96d8-624c7440a40e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ee40167-a18f-4159-bd79-1cfac2235d6d"}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:23.310330 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=15 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:57:23.310997 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:57:23.434891 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] validate_networks() for [('0ee40167-a18f-4159-bd79-1cfac2235d6d', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 22:57:23.857335 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 22:57:23.857965 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 22:57:23.858354 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 22:57:23.858752 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 22:57:23.859206 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 22:57:23.868698 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:23.869140 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:23.869964 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:23.871108 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:23.893312 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 22:57:23.898477 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Getting quotas for user 4bba292314fd415f94fb537237d9d898 and project 8b83b190c95f4ed8901f10c9fc67b365. Resources: {'ram', 'instances', 'cores'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 22:57:23.959084 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 22:57:23.961165 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c4d00fc-3daf-4302-96d8-624c7440a40e',volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 22:57:24.108804 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [210087f7-2372-4552-a72f-9f8950976591] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 22:57:25.118085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [210087f7-2372-4552-a72f-9f8950976591] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 56612. Aug 01 22:57:25.122664 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-62be1fb0-7b63-4992-a541-682f2ad5fec1 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.826467 Aug 01 22:57:25.123518 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 564/1108] 10.222.0.47 () {60 vars in 1147 bytes} [Mon Aug 1 22:57:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 22:57:25.134748 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-4003a0d5-0b10-4811-8a2a-84e4791f35ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:25.135431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-4003a0d5-0b10-4811-8a2a-84e4791f35ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:25.137481 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=12 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:57:25.138284 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=36 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:57:25.199573 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-4003a0d5-0b10-4811-8a2a-84e4791f35ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:25.207013 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-4003a0d5-0b10-4811-8a2a-84e4791f35ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1094 microversion: 2.1 time: 0.076369 Aug 01 22:57:25.207649 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 545/1109] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:25 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:26.229336 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dc10c221-51b5-4d01-bff4-cd0d4b3592fd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:26.229953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dc10c221-51b5-4d01-bff4-cd0d4b3592fd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:26.282251 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dc10c221-51b5-4d01-bff4-cd0d4b3592fd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:26.289290 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dc10c221-51b5-4d01-bff4-cd0d4b3592fd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1094 microversion: 2.1 time: 0.064660 Aug 01 22:57:26.289893 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 565/1110] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:26 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:27.309900 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-e9ca828d-cd89-4ddf-8704-7ff61ffd2056 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:27.310358 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-e9ca828d-cd89-4ddf-8704-7ff61ffd2056 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:27.363513 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-e9ca828d-cd89-4ddf-8704-7ff61ffd2056 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:27.372414 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-e9ca828d-cd89-4ddf-8704-7ff61ffd2056 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1094 microversion: 2.1 time: 0.066412 Aug 01 22:57:27.373137 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 546/1111] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:27 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:28.396755 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ec6c5047-91ba-43f3-aaad-4140136ce882 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:28.397515 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ec6c5047-91ba-43f3-aaad-4140136ce882 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:28.457900 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ec6c5047-91ba-43f3-aaad-4140136ce882 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:28.465357 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ec6c5047-91ba-43f3-aaad-4140136ce882 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1094 microversion: 2.1 time: 0.072629 Aug 01 22:57:28.466126 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 566/1112] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:28 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:29.495276 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:29.495894 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:29.504619 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:29.505210 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:29.506197 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:29.506629 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:29.570305 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:29.581504 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-058f9e68-fc03-4409-b94c-c6e9dec6753d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1144 microversion: 2.1 time: 0.089911 Aug 01 22:57:29.582196 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 547/1113] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:29 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:30.604764 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:30.605460 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:30.612570 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:30.613011 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:30.613865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:30.614263 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:30.688293 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:30.696779 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a17719e9-385f-4f35-b6c0-df7dddba2f53 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1210 microversion: 2.1 time: 0.096554 Aug 01 22:57:30.697441 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 567/1114] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:30 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:31.720836 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:31.721463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:31.728177 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:31.728635 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:31.729383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:31.729886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:31.922581 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:31.931689 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-6116b239-3cf1-4dee-9059-4237cf72c88d tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.215285 Aug 01 22:57:31.932500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 548/1115] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:31 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:31.961929 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-60141b7a-f865-4e3b-b00b-46f53468b21e req-6f701a47-96f2-4805-aa41-d36bdc47c6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b62338-1f5a-435d-a93b-67544332b5b6", "tag": "ddd62c93-ee41-424d-8c00-f1915ecc97c5"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:31.974813 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-60141b7a-f865-4e3b-b00b-46f53468b21e req-6f701a47-96f2-4805-aa41-d36bdc47c6bc service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:31.975291 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-60141b7a-f865-4e3b-b00b-46f53468b21e req-6f701a47-96f2-4805-aa41-d36bdc47c6bc service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:31.988269 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-60141b7a-f865-4e3b-b00b-46f53468b21e req-6f701a47-96f2-4805-aa41-d36bdc47c6bc service nova] Creating event network-changed:ddd62c93-ee41-424d-8c00-f1915ecc97c5 for instance 13b62338-1f5a-435d-a93b-67544332b5b6 on hv-cinder-85164 Aug 01 22:57:31.993316 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-60141b7a-f865-4e3b-b00b-46f53468b21e req-6f701a47-96f2-4805-aa41-d36bdc47c6bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035642 Aug 01 22:57:31.993969 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 568/1116] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:57:32.954878 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:32.955533 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:32.962431 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:32.962881 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:32.963657 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:32.964146 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:33.199087 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:33.207097 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-49bba922-8f0a-43da-b239-5908ee2efba8 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.256208 Aug 01 22:57:33.207662 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 549/1117] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:32 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:33.765287 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-49482298"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:33.765936 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:33.773380 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:33.773854 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:33.774781 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:33.775316 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:33.879838 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:57:33.911591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.network.security_group_api [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Removing security group 9fe93b45-4e00-4109-a251-4a1c56627883 from port 5d1159a0-d46b-43dc-ab5f-e11e7c19e938 Aug 01 22:57:34.253022 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bdf9552b-cd67-4c9b-9e49-e4bb401ab5fb tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/action" status: 202 len: 0 microversion: 2.1 time: 0.492460 Aug 01 22:57:34.254778 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 569/1118] 10.222.0.47 () {60 vars in 1278 bytes} [Mon Aug 1 22:57:33 2022] POST /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 22:57:34.274824 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-526ccdc9-5624-4269-990c-b5cfb80451a0 req-db3fe19a-95bc-4c7e-a488-7083e9b229d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322e4a4f-9cee-46c0-bed2-eaca58198680", "tag": "5d1159a0-d46b-43dc-ab5f-e11e7c19e938"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:34.287039 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-526ccdc9-5624-4269-990c-b5cfb80451a0 req-db3fe19a-95bc-4c7e-a488-7083e9b229d0 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:34.288085 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-526ccdc9-5624-4269-990c-b5cfb80451a0 req-db3fe19a-95bc-4c7e-a488-7083e9b229d0 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:34.306213 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-526ccdc9-5624-4269-990c-b5cfb80451a0 req-db3fe19a-95bc-4c7e-a488-7083e9b229d0 service nova] Creating event network-changed:5d1159a0-d46b-43dc-ab5f-e11e7c19e938 for instance 322e4a4f-9cee-46c0-bed2-eaca58198680 on hv-cinder-85164 Aug 01 22:57:34.317369 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-526ccdc9-5624-4269-990c-b5cfb80451a0 req-db3fe19a-95bc-4c7e-a488-7083e9b229d0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045743 Aug 01 22:57:34.319532 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 570/1119] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:57:34.352061 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:34.352803 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:34.359192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:34.359771 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:34.360794 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:34.361298 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:34.626499 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:34.638457 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a7980b9d-49e1-47ca-8e32-54ea44723f67 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.413267 Aug 01 22:57:34.639907 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 550/1120] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:34 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:35.543332 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:35.543914 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:35.551192 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:35.551636 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:35.552478 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:35.552918 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:35.636952 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lazy-loading 'services' on Instance uuid 322e4a4f-9cee-46c0-bed2-eaca58198680 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 22:57:35.663355 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:35.664076 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:35.671112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:35.671658 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:35.672535 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:35.673051 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:35.715750 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-23c9a258-5324-4539-b9a3-f1e37cfdc4b2 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "DELETE /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments/7c5a9423-4149-48b4-b68b-cc7f85b3629f" status: 202 len: 0 microversion: 2.1 time: 0.176521 Aug 01 22:57:35.716492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 571/1121] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:57:35 2022] DELETE /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments/7c5a9423-4149-48b4-b68b-cc7f85b3629f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:57:35.731557 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7faaec4e-efff-4552-9e29-6e1f2ea77f45 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:35.735592 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7faaec4e-efff-4552-9e29-6e1f2ea77f45 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:35.747080 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7faaec4e-efff-4552-9e29-6e1f2ea77f45 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:35.749134 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7faaec4e-efff-4552-9e29-6e1f2ea77f45 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:35.750420 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7faaec4e-efff-4552-9e29-6e1f2ea77f45 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:35.751700 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7faaec4e-efff-4552-9e29-6e1f2ea77f45 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:35.793370 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7faaec4e-efff-4552-9e29-6e1f2ea77f45 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067951 Aug 01 22:57:35.797989 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 572/1122] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:57:35 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:57:35.841016 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:35.849989 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-a38e955d-a3df-458d-9581-ec50882391cd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.191236 Aug 01 22:57:35.850800 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 551/1123] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:35 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:36.343494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-1503f809-70ff-44df-b5d6-3bcd478f9284 req-dc9281a6-7cc6-4fe0-bed2-6ffc4e25618d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322e4a4f-9cee-46c0-bed2-eaca58198680", "tag": "5d1159a0-d46b-43dc-ab5f-e11e7c19e938"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:36.354573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-1503f809-70ff-44df-b5d6-3bcd478f9284 req-dc9281a6-7cc6-4fe0-bed2-6ffc4e25618d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:36.355062 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-1503f809-70ff-44df-b5d6-3bcd478f9284 req-dc9281a6-7cc6-4fe0-bed2-6ffc4e25618d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:36.367981 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-1503f809-70ff-44df-b5d6-3bcd478f9284 req-dc9281a6-7cc6-4fe0-bed2-6ffc4e25618d service nova] Creating event network-changed:5d1159a0-d46b-43dc-ab5f-e11e7c19e938 for instance 322e4a4f-9cee-46c0-bed2-eaca58198680 on hv-cinder-85164 Aug 01 22:57:36.373465 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-1503f809-70ff-44df-b5d6-3bcd478f9284 req-dc9281a6-7cc6-4fe0-bed2-6ffc4e25618d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033655 Aug 01 22:57:36.374232 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 573/1124] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:57:36.806623 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-0b385e93-936b-48cd-96a9-56fff9e097b1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:36.808933 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-0b385e93-936b-48cd-96a9-56fff9e097b1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:36.816403 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b385e93-936b-48cd-96a9-56fff9e097b1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:36.816943 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b385e93-936b-48cd-96a9-56fff9e097b1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:36.818328 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b385e93-936b-48cd-96a9-56fff9e097b1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:36.818456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-0b385e93-936b-48cd-96a9-56fff9e097b1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:36.851564 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-0b385e93-936b-48cd-96a9-56fff9e097b1 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049219 Aug 01 22:57:36.852127 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 552/1125] 10.222.0.47 () {58 vars in 1302 bytes} [Mon Aug 1 22:57:36 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 22:57:36.863489 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:36.864106 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:36.872690 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:36.873178 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:36.873463 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:36.873996 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:36.874116 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:36.874433 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:36.880702 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:36.881135 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:36.882008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:36.882440 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:36.961931 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] HTTP exception thrown: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 is not attached to volume 7c5a9423-4149-48b4-b68b-cc7f85b3629f Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Request method failure captured: Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments/7c5a9423-4149-48b4-b68b-cc7f85b3629f HTTP/1.1 Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6FnfxbaoNKtUaOr_w0pPCj_yaGNO8P-KoX1-6zNxjTPIuBKCzu_ghgxkZ55Cac2BVf6IXGFmbvVCWtJGFMYv33ce2849pLuII26-k7UBwG4q9txkimnqdnCPg4-7_1d1NxbkGToiy3e2BkEv9Izqf3oSP4LC244KZ3WR_R2Ql290WII Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 243a702bf7464281a76960b63e849b76 Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-TestMinimumBasicScenario-1336006720 Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:57:36.964535 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/243a702bf7464281a76960b63e849b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_243a702bf7464281a76960b63e849b76", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/243a702bf7464281a76960b63e849b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/243a702bf7464281a76960b63e849b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-TestMinimumBasicScenario-1336006720 Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 243a702bf7464281a76960b63e849b76 Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1336006720 Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-TestMinimumBasicScenario-1336006720-project Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 5ff80fefdd364fc1b0a9a4c54c1e1a30 Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-TestMinimumBasicScenario-1336006720-project Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:57:36.966360 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 is not attached to volume 7c5a9423-4149-48b4-b68b-cc7f85b3629f Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'server_id': '322e4a4f-9cee-46c0-bed2-eaca58198680', 'id': '7c5a9423-4149-48b4-b68b-cc7f85b3629f'} Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7c5a9423-4149-48b4-b68b-cc7f85b3629f. Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:57:36.967185 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 is not attached to volume 7c5a9423-4149-48b4-b68b-cc7f85b3629f Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 is not attached to volume 7c5a9423-4149-48b4-b68b-cc7f85b3629f Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:57:36.968896 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Returning 404 to user: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 is not attached to volume 7c5a9423-4149-48b4-b68b-cc7f85b3629f {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:57:36.970519 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-69cbdb20-0cf9-4c8f-bda1-16e59b8cd823 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "DELETE /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments/7c5a9423-4149-48b4-b68b-cc7f85b3629f" status: 404 len: 154 microversion: 2.1 time: 0.107963 Aug 01 22:57:36.970519 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 574/1126] 10.222.0.47 () {58 vars in 1416 bytes} [Mon Aug 1 22:57:36 2022] DELETE /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680/os-volume_attachments/7c5a9423-4149-48b4-b68b-cc7f85b3629f => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:57:37.054288 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:37.063318 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-848dce00-e646-4f27-9a04-dbeb69620d3a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.195594 Aug 01 22:57:37.063922 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 553/1127] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:36 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:57:38.087640 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:38.088497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:38.099539 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:38.099892 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:38.100832 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:38.101273 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:38.147255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:38.147979 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:38.149846 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell0:SELECT=4 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:57:38.157153 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:38.157631 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:38.158530 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:38.158970 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:38.186750 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Going to try to terminate instance {{(pid=124356) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:57:38.253783 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:38.263033 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-efa5ec74-1d01-400d-902e-660d04cfad02 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.181011 Aug 01 22:57:38.263622 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 575/1128] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:38 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:38.282985 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5f732c17-2962-4d24-8e6a-e2b2e35a1006 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "DELETE /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 204 len: 0 microversion: 2.1 time: 0.140232 Aug 01 22:57:38.283674 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 554/1129] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:57:38 2022] DELETE /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:57:38.293849 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:38.294565 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:38.302367 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:38.302811 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:38.303790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:38.304224 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:38.454509 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:38.461654 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=10 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:57:38.464407 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-26bb552f-30ab-4e3d-b57d-31a6d4a6135d tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1554 microversion: 2.1 time: 0.175376 Aug 01 22:57:38.464997 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 576/1130] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:38 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 22:57:39.293192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:39.293825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:39.303892 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:39.304344 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:39.305130 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:39.305601 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:39.450824 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:39.459275 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-1a6597eb-ed00-4405-9d8a-1d688472ceca tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.170439 Aug 01 22:57:39.460118 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 555/1131] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:39 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:39.489128 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:39.489782 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:39.497873 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:39.498311 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:39.499108 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:39.499529 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:39.647573 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:39.656222 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b49b5e73-6a59-4243-859e-3e5d4ea3518c tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1554 microversion: 2.1 time: 0.171448 Aug 01 22:57:39.656779 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 577/1132] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:39 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:40.488547 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:40.489249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:40.496383 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:40.496835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:40.497705 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:40.498140 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:40.668833 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:40.676871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-228dff8d-4410-43e9-a256-0979cdb7fabc tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.192232 Aug 01 22:57:40.677456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 556/1133] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:40 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:40.678321 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:40.678962 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:40.685966 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:40.686417 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:40.687191 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:40.687625 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:40.822410 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ff80fefdd364fc1b0a9a4c54c1e1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243a702bf7464281a76960b63e849b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:40.830216 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-57b4f4a9-3e07-4824-a117-00b84601d660 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 200 len: 1554 microversion: 2.1 time: 0.155979 Aug 01 22:57:40.831028 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 578/1134] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:40 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:41.083565 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-7b17ab66-d323-4f35-b89d-536d0e63c6e6 req-4bf2c192-978b-4f24-b0b3-e671fc94bc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322e4a4f-9cee-46c0-bed2-eaca58198680", "name": "network-vif-deleted", "tag": "5d1159a0-d46b-43dc-ab5f-e11e7c19e938"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:41.093271 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7b17ab66-d323-4f35-b89d-536d0e63c6e6 req-4bf2c192-978b-4f24-b0b3-e671fc94bc98 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:41.093724 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-7b17ab66-d323-4f35-b89d-536d0e63c6e6 req-4bf2c192-978b-4f24-b0b3-e671fc94bc98 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:41.108694 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-7b17ab66-d323-4f35-b89d-536d0e63c6e6 req-4bf2c192-978b-4f24-b0b3-e671fc94bc98 service nova] Creating event network-vif-deleted:5d1159a0-d46b-43dc-ab5f-e11e7c19e938 for instance 322e4a4f-9cee-46c0-bed2-eaca58198680 on hv-cinder-85164 Aug 01 22:57:41.115293 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-7b17ab66-d323-4f35-b89d-536d0e63c6e6 req-4bf2c192-978b-4f24-b0b3-e671fc94bc98 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035286 Aug 01 22:57:41.115949 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 557/1135] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:57:41.701304 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:41.701953 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:41.709424 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:41.709955 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:41.710916 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:41.711345 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:41.852020 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:41.852610 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] [instance: 322e4a4f-9cee-46c0-bed2-eaca58198680] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:41.856337 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:41.863112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:41.863835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:41.864604 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:41.865160 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4dfbeb79-0602-4588-9622-b4eec5baa5ac tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.168972 Aug 01 22:57:41.865315 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:41.878273 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 579/1136] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:41 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:41.879659 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] HTTP exception thrown: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 could not be found. Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Request method failure captured: Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 HTTP/1.1 Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6FnfxbaoNKtUaOr_w0pPCj_yaGNO8P-KoX1-6zNxjTPIuBKCzu_ghgxkZ55Cac2BVf6IXGFmbvVCWtJGFMYv33ce2849pLuII26-k7UBwG4q9txkimnqdnCPg4-7_1d1NxbkGToiy3e2BkEv9Izqf3oSP4LC244KZ3WR_R2Ql290WII Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 243a702bf7464281a76960b63e849b76 Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-TestMinimumBasicScenario-1336006720 Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:57:41.881447 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/243a702bf7464281a76960b63e849b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_243a702bf7464281a76960b63e849b76", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/243a702bf7464281a76960b63e849b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/243a702bf7464281a76960b63e849b76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-TestMinimumBasicScenario-1336006720 Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 243a702bf7464281a76960b63e849b76 Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1336006720 Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-TestMinimumBasicScenario-1336006720-project Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 5ff80fefdd364fc1b0a9a4c54c1e1a30 Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-TestMinimumBasicScenario-1336006720-project Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 could not be found. Aug 01 22:57:41.882966 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '322e4a4f-9cee-46c0-bed2-eaca58198680'} Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 could not be found. Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:57:41.884034 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 could not be found. Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 could not be found. Aug 01 22:57:41.885459 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:57:41.886835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Returning 404 to user: Instance 322e4a4f-9cee-46c0-bed2-eaca58198680 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:57:41.886835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-3aa24405-bc77-46bc-aec9-c10bb6716825 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680" status: 404 len: 111 microversion: 2.1 time: 0.035376 Aug 01 22:57:41.886835 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 558/1137] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:41 2022] GET /compute/v2.1/servers/322e4a4f-9cee-46c0-bed2-eaca58198680 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:57:41.892388 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8cb26b26-2721-42dc-8e7b-d43eb3f42583 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] Calling method '.version_select at 0x7fc541a66b80>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:41.913208 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8cb26b26-2721-42dc-8e7b-d43eb3f42583 tempest-TestMinimumBasicScenario-1336006720 tempest-TestMinimumBasicScenario-1336006720-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-952599752" status: 202 len: 0 microversion: 2.1 time: 0.024640 Aug 01 22:57:41.913866 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 580/1138] 10.222.0.47 () {58 vars in 1269 bytes} [Mon Aug 1 22:57:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-952599752 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 22:57:42.886069 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:42.886817 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:42.893707 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:42.894166 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:42.894931 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:42.895362 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:43.039799 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:43.047902 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-268fc9c0-5029-4ad3-a2e6-13bba942df37 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.166333 Aug 01 22:57:43.048700 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 559/1139] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:42 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:43.584319 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-a94eadff-fa8d-459c-8b0e-d95124cba1dc req-296ce60e-f5c3-4b72-9462-ebc807683f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b62338-1f5a-435d-a93b-67544332b5b6", "name": "network-vif-plugged", "status": "completed", "tag": "ddd62c93-ee41-424d-8c00-f1915ecc97c5"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:43.607744 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a94eadff-fa8d-459c-8b0e-d95124cba1dc req-296ce60e-f5c3-4b72-9462-ebc807683f09 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:43.608735 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a94eadff-fa8d-459c-8b0e-d95124cba1dc req-296ce60e-f5c3-4b72-9462-ebc807683f09 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:43.620562 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-a94eadff-fa8d-459c-8b0e-d95124cba1dc req-296ce60e-f5c3-4b72-9462-ebc807683f09 service nova] Creating event network-vif-plugged:ddd62c93-ee41-424d-8c00-f1915ecc97c5 for instance 13b62338-1f5a-435d-a93b-67544332b5b6 on hv-cinder-85164 Aug 01 22:57:43.626717 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-a94eadff-fa8d-459c-8b0e-d95124cba1dc req-296ce60e-f5c3-4b72-9462-ebc807683f09 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047043 Aug 01 22:57:43.627890 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 581/1140] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 22:57:44.068613 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:44.069248 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:44.076388 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:44.076840 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:44.077611 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:44.078062 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:44.338324 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:44.348789 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-66542d0a-509b-4214-bac1-af7bc5894879 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.284152 Aug 01 22:57:44.349379 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 560/1141] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:44 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:45.371762 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:45.373365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:45.379497 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:45.380250 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:45.381042 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:45.381734 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:45.553602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:45.565066 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8b7c391c-e044-420a-a6cd-b685d8cb19b0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1266 microversion: 2.1 time: 0.198767 Aug 01 22:57:45.566079 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 582/1142] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:45 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:46.587539 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:46.588163 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:46.595489 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:46.595940 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:46.596735 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:46.597170 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:46.820946 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:46.830148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-486da049-87ea-4ee6-955f-a7171d638be2 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1451 microversion: 2.1 time: 0.247335 Aug 01 22:57:46.830716 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 561/1143] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:46 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1451 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:46.851047 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:57:46.851651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:57:46.859416 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:46.859869 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:46.860670 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:46.861095 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:46.999318 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:57:47.007214 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-14a128e8-2d09-41f3-9adf-bec03294e3af tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1451 microversion: 2.1 time: 0.160100 Aug 01 22:57:47.007801 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 583/1144] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:57:46 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:57:48.803604 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-f03e65e2-488b-4ed4-9091-b5b99a7c25c6 req-bb5e3ffb-80ef-4265-a94b-368fc12946ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b62338-1f5a-435d-a93b-67544332b5b6", "tag": "ddd62c93-ee41-424d-8c00-f1915ecc97c5"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:57:48.822618 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f03e65e2-488b-4ed4-9091-b5b99a7c25c6 req-bb5e3ffb-80ef-4265-a94b-368fc12946ab service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:57:48.825466 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-f03e65e2-488b-4ed4-9091-b5b99a7c25c6 req-bb5e3ffb-80ef-4265-a94b-368fc12946ab service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:57:48.852701 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-f03e65e2-488b-4ed4-9091-b5b99a7c25c6 req-bb5e3ffb-80ef-4265-a94b-368fc12946ab service nova] Creating event network-changed:ddd62c93-ee41-424d-8c00-f1915ecc97c5 for instance 13b62338-1f5a-435d-a93b-67544332b5b6 on hv-cinder-85164 Aug 01 22:57:48.859597 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-f03e65e2-488b-4ed4-9091-b5b99a7c25c6 req-bb5e3ffb-80ef-4265-a94b-368fc12946ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060037 Aug 01 22:57:48.860668 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 562/1145] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:58:22.794008 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 22:58:22.795163 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Mon Aug 1 22:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 22:59:21.656822 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:59:21.657548 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG dbcounter [-] [124356] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:59:21.663591 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:21.664094 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:21.667915 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-78c8b547-8ecb-467d-858e-837b30e80dc4 req-58b4a8bc-6972-4805-ab64-da5415da83e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b62338-1f5a-435d-a93b-67544332b5b6", "tag": "ddd62c93-ee41-424d-8c00-f1915ecc97c5"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:59:21.680030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:59:21.680767 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 22:59:21.685865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:21.686313 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:21.687097 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:21.687527 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:21.690437 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-78c8b547-8ecb-467d-858e-837b30e80dc4 req-58b4a8bc-6972-4805-ab64-da5415da83e3 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:21.690912 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-78c8b547-8ecb-467d-858e-837b30e80dc4 req-58b4a8bc-6972-4805-ab64-da5415da83e3 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:21.704590 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-78c8b547-8ecb-467d-858e-837b30e80dc4 req-58b4a8bc-6972-4805-ab64-da5415da83e3 service nova] Creating event network-changed:ddd62c93-ee41-424d-8c00-f1915ecc97c5 for instance 13b62338-1f5a-435d-a93b-67544332b5b6 on hv-cinder-85164 Aug 01 22:59:21.710365 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-78c8b547-8ecb-467d-858e-837b30e80dc4 req-58b4a8bc-6972-4805-ab64-da5415da83e3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055363 Aug 01 22:59:21.711401 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 563/1146] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:59:21.727021 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:59:21.822947 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4f123b22-dfa5-4005-b37f-1696ff6f8d1f tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "DELETE /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 204 len: 0 microversion: 2.1 time: 0.170535 Aug 01 22:59:21.823784 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 584/1147] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:59:21 2022] DELETE /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:59:21.833369 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:21.834255 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:21.841886 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:21.842336 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:21.843148 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:21.843585 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:22.143524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:59:22.152028 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-bf2a908d-66c6-4026-b5e5-7769b7d02a4a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1576 microversion: 2.1 time: 0.323492 Aug 01 22:59:22.152601 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 564/1148] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:21 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1576 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:59:23.176721 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:23.177492 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:23.185096 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:23.185580 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:23.186365 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:23.186790 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:23.389050 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:59:23.398874 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c082c308-2d6f-44ff-bd95-c397981cb1e7 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1576 microversion: 2.1 time: 0.227301 Aug 01 22:59:23.399447 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 585/1149] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:23 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1576 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:59:24.269304 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-27b43479-0417-4901-8c71-e069d2e5d37d req-ac4b6eb1-06f9-456e-99bb-4bfcd5b28507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b62338-1f5a-435d-a93b-67544332b5b6", "name": "network-vif-deleted", "tag": "ddd62c93-ee41-424d-8c00-f1915ecc97c5"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:59:24.279017 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-27b43479-0417-4901-8c71-e069d2e5d37d req-ac4b6eb1-06f9-456e-99bb-4bfcd5b28507 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:24.279456 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-27b43479-0417-4901-8c71-e069d2e5d37d req-ac4b6eb1-06f9-456e-99bb-4bfcd5b28507 service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:24.290871 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-27b43479-0417-4901-8c71-e069d2e5d37d req-ac4b6eb1-06f9-456e-99bb-4bfcd5b28507 service nova] Creating event network-vif-deleted:ddd62c93-ee41-424d-8c00-f1915ecc97c5 for instance 13b62338-1f5a-435d-a93b-67544332b5b6 on hv-cinder-85164 Aug 01 22:59:24.296575 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-27b43479-0417-4901-8c71-e069d2e5d37d req-ac4b6eb1-06f9-456e-99bb-4bfcd5b28507 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094779 Aug 01 22:59:24.297216 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 565/1150] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:59:24.421276 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:24.421887 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:24.428917 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:24.429382 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:24.430199 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:24.430634 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:24.503842 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:59:24.512688 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-70ee2a7e-07ab-4981-9b94-556cf71356dd tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 200 len: 1225 microversion: 2.1 time: 0.095882 Aug 01 22:59:24.520244 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 586/1151] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:24 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:59:25.535046 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:25.535749 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 13b62338-1f5a-435d-a93b-67544332b5b6] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:25.542460 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:25.542916 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:25.543685 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:25.544112 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:25.558587 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] HTTP exception thrown: Instance 13b62338-1f5a-435d-a93b-67544332b5b6 could not be found. Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Request method failure captured: Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 HTTP/1.1 Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fks-t5UYtglEiOLKCwO87djTu96AvqoNVoAJwdWt2MfxSegR0PGfvsLz7IclOokTUXexh91fuhqlrXR5xCk82vHVyXZ5d_HBb_OkK6Mgy_H33XRdD62Ss3nwNnUG6lE16KsZZJrEOKg6OLA449PudexpCs4JQexc5w8D08uIyT5iFY Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:59:25.560257 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8b83b190c95f4ed8901f10c9fc67b365", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 4bba292314fd415f94fb537237d9d898 Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 13b62338-1f5a-435d-a93b-67544332b5b6 could not be found. Aug 01 22:59:25.561938 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '13b62338-1f5a-435d-a93b-67544332b5b6'} Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b62338-1f5a-435d-a93b-67544332b5b6 could not be found. Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:59:25.563049 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b62338-1f5a-435d-a93b-67544332b5b6 could not be found. Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b62338-1f5a-435d-a93b-67544332b5b6 could not be found. Aug 01 22:59:25.565602 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:25.567796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Returning 404 to user: Instance 13b62338-1f5a-435d-a93b-67544332b5b6 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:59:25.567796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-84f6112a-353b-4f74-a496-9be002e3a3c0 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6" status: 404 len: 111 microversion: 2.1 time: 0.031475 Aug 01 22:59:25.567796 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 566/1152] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:25 2022] GET /compute/v2.1/servers/13b62338-1f5a-435d-a93b-67544332b5b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:59:28.732221 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:28.732884 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:28.735057 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-5ffe0431-e9a7-4cce-a80b-5070c500d852 req-04316de2-5f32-4430-95a9-e1e67a03211d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc28627-645c-4fd2-aea0-55ad51a5ebda", "tag": "7bc46797-5668-4b8f-8988-48f3cf5e2499"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:59:28.741122 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:28.741757 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:28.742786 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:28.743386 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:28.747037 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-5ffe0431-e9a7-4cce-a80b-5070c500d852 req-04316de2-5f32-4430-95a9-e1e67a03211d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:28.747793 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-5ffe0431-e9a7-4cce-a80b-5070c500d852 req-04316de2-5f32-4430-95a9-e1e67a03211d service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:28.760527 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-5ffe0431-e9a7-4cce-a80b-5070c500d852 req-04316de2-5f32-4430-95a9-e1e67a03211d service nova] Creating event network-changed:7bc46797-5668-4b8f-8988-48f3cf5e2499 for instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda on hv-cinder-85164 Aug 01 22:59:28.766858 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-5ffe0431-e9a7-4cce-a80b-5070c500d852 req-04316de2-5f32-4430-95a9-e1e67a03211d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035505 Aug 01 22:59:28.767729 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 567/1153] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:59:28.771130 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 22:59:28.863514 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1e5661d9-2c15-4ec9-b96b-a0f33d8f69d4 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 204 len: 0 microversion: 2.1 time: 0.134651 Aug 01 22:59:28.864657 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 587/1154] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:59:28 2022] DELETE /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 22:59:28.874500 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:28.875851 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:28.883812 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:28.884261 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:28.885047 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:28.885490 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:29.055302 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.policy [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124356) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:59:29.063462 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-5303455c-2627-47fc-b00a-c315c44042aa tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1574 microversion: 2.1 time: 0.193943 Aug 01 22:59:29.064015 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 568/1155] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:28 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:59:30.086569 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:30.087198 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:30.094297 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:30.094739 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:30.095865 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:30.096316 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:30.259461 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:59:30.268030 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bb967dca-5c9d-4cf2-9a5b-fcfda4e8527e tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1574 microversion: 2.1 time: 0.185781 Aug 01 22:59:30.268602 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 588/1156] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:30 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:59:31.084606 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [req-2b4dcb06-2979-45eb-8beb-3d7affe63b85 req-5e32e4d4-1bc2-4eb5-8048-3f50b383fbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc28627-645c-4fd2-aea0-55ad51a5ebda", "name": "network-vif-deleted", "tag": "7bc46797-5668-4b8f-8988-48f3cf5e2499"}]} {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 22:59:31.094816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-2b4dcb06-2979-45eb-8beb-3d7affe63b85 req-5e32e4d4-1bc2-4eb5-8048-3f50b383fbce service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:31.095684 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [req-2b4dcb06-2979-45eb-8beb-3d7affe63b85 req-5e32e4d4-1bc2-4eb5-8048-3f50b383fbce service nova] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:31.107941 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.compute.server_external_events [req-2b4dcb06-2979-45eb-8beb-3d7affe63b85 req-5e32e4d4-1bc2-4eb5-8048-3f50b383fbce service nova] Creating event network-vif-deleted:7bc46797-5668-4b8f-8988-48f3cf5e2499 for instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda on hv-cinder-85164 Aug 01 22:59:31.113281 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [req-2b4dcb06-2979-45eb-8beb-3d7affe63b85 req-5e32e4d4-1bc2-4eb5-8048-3f50b383fbce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Aug 01 22:59:31.113955 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 569/1157] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Aug 1 22:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 22:59:31.288835 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:31.289468 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:31.296476 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:31.296861 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:31.297642 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:31.298076 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:31.368439 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bba292314fd415f94fb537237d9d898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b83b190c95f4ed8901f10c9fc67b365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 22:59:31.378583 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c090afbb-f256-46db-9327-7672be6a0e74 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 200 len: 1224 microversion: 2.1 time: 0.093759 Aug 01 22:59:31.379597 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 589/1158] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:31 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 22:59:32.407825 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:32.408770 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 9dc28627-645c-4fd2-aea0-55ad51a5ebda] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:32.419386 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:32.420126 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:32.421372 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:32.422249 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:32.436801 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] HTTP exception thrown: Instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda could not be found. Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Request method failure captured: Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda HTTP/1.1 Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fks-t5UYtglEiOLKCwO87djTu96AvqoNVoAJwdWt2MfxSegR0PGfvsLz7IclOokTUXexh91fuhqlrXR5xCk82vHVyXZ5d_HBb_OkK6Mgy_H33XRdD62Ss3nwNnUG6lE16KsZZJrEOKg6OLA449PudexpCs4JQexc5w8D08uIyT5iFY Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:59:32.438446 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8b83b190c95f4ed8901f10c9fc67b365", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 4bba292314fd415f94fb537237d9d898 Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda could not be found. Aug 01 22:59:32.440211 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '9dc28627-645c-4fd2-aea0-55ad51a5ebda'} Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda could not be found. Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:59:32.441329 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda could not be found. Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda could not be found. Aug 01 22:59:32.443816 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.445599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Returning 404 to user: Instance 9dc28627-645c-4fd2-aea0-55ad51a5ebda could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:59:32.445599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-7494dff6-3a61-4f4a-947a-57df759eeb5a tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda" status: 404 len: 111 microversion: 2.1 time: 0.040227 Aug 01 22:59:32.445599 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 570/1159] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:32 2022] GET /compute/v2.1/servers/9dc28627-645c-4fd2-aea0-55ad51a5ebda => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:59:32.913651 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:32.914172 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:32.921113 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:32.921496 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:32.922288 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:32.922737 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:32.937955 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] HTTP exception thrown: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Request method failure captured: Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 HTTP/1.1 Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept: application/json Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Connection: close Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Length: 0 Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Content-Type: application/json Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Host: 10.222.0.47 Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.10 Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABi6Fks-t5UYtglEiOLKCwO87djTu96AvqoNVoAJwdWt2MfxSegR0PGfvsLz7IclOokTUXexh91fuhqlrXR5xCk82vHVyXZ5d_HBb_OkK6Mgy_H33XRdD62Ss3nwNnUG6lE16KsZZJrEOKg6OLA449PudexpCs4JQexc5w8D08uIyT5iFY Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Role: member,reader Aug 01 22:59:32.939669 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Roles: member,reader Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8b83b190c95f4ed8901f10c9fc67b365", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Id: 4bba292314fd415f94fb537237d9d898 Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: method: > Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: exception: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.941481 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: action_args: {'id': '513fe11b-f879-4c6f-81fa-6f9747182d90'} Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:59:32.942493 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.944116 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.945645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Returning 404 to user: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:59:32.945645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9fe778c2-d374-477a-8d02-04f6c9628f30 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "DELETE /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 404 len: 111 microversion: 2.1 time: 0.033075 Aug 01 22:59:32.945645 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 590/1160] 10.222.0.47 () {58 vars in 1239 bytes} [Mon Aug 1 22:59:32 2022] DELETE /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:59:32.952842 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '>' {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:32.953710 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.compute.api [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] [instance: 513fe11b-f879-4c6f-81fa-6f9747182d90] Fetching instance by UUID {{(pid=124356) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 22:59:32.962669 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:32.963922 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:32.964839 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 22:59:32.965277 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG oslo_concurrency.lockutils [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Lock "794832fa-2d4b-444b-8427-3666cab1df17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 22:59:32.982977 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.wsgi [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] HTTP exception thrown: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Request method failure captured: Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: request: GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 HTTP/1.1 Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept: application/json Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Accept-Encoding: identity Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Connection: close Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Length: 0 Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Content-Type: application/json Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Host: 10.222.0.47 Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Openstack-System-Scope: None Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: User-Agent: python-urllib3/1.26.10 Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Auth-Token: gAAAAABi6Fks-t5UYtglEiOLKCwO87djTu96AvqoNVoAJwdWt2MfxSegR0PGfvsLz7IclOokTUXexh91fuhqlrXR5xCk82vHVyXZ5d_HBb_OkK6Mgy_H33XRdD62Ss3nwNnUG6lE16KsZZJrEOKg6OLA449PudexpCs4JQexc5w8D08uIyT5iFY Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Id: None Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Domain-Name: None Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Identity-Status: Confirmed Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Is-Admin-Project: True Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Id: default Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Domain-Name: Default Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Project-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Role: member,reader Aug 01 22:59:32.984524 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Roles: member,reader Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8b83b190c95f4ed8901f10c9fc67b365", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8b83b190c95f4ed8901f10c9fc67b365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}] Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Id: 8b83b190c95f4ed8901f10c9fc67b365 Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-Tenant-Name: tempest-TestVolumeBootPattern-438672709 Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Id: default Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Domain-Name: Default Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Id: 4bba292314fd415f94fb537237d9d898 Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: X-User-Name: tempest-TestVolumeBootPattern-438672709-project Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: method: > Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: exception: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.986192 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: action_args: {'id': '513fe11b-f879-4c6f-81fa-6f9747182d90'} Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: {{(pid=124356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 22:59:32.987050 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. Aug 01 22:59:32.988351 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: ERROR nova.api.openstack.wsgi Aug 01 22:59:32.989660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: DEBUG nova.api.openstack.wsgi [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Returning 404 to user: Instance 513fe11b-f879-4c6f-81fa-6f9747182d90 could not be found. {{(pid=124356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 22:59:32.989660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO nova.api.openstack.requestlog [None req-92d9866a-5298-4338-80f1-45a0578bdace tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90" status: 404 len: 111 microversion: 2.1 time: 0.039449 Aug 01 22:59:32.989660 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: [pid: 124356|app: 0|req: 571/1161] 10.222.0.47 () {58 vars in 1236 bytes} [Mon Aug 1 22:59:32 2022] GET /compute/v2.1/servers/513fe11b-f879-4c6f-81fa-6f9747182d90 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 22:59:33.882277 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 22:59:33.883552 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Mon Aug 1 22:59:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 22:59:34.323543 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e5af2ee7-162e-4f68-9e9d-c565b61f8421 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] Calling method '.version_select at 0x7fc541a66310>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 22:59:34.350102 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e5af2ee7-162e-4f68-9e9d-c565b61f8421 tempest-TestVolumeBootPattern-438672709 tempest-TestVolumeBootPattern-438672709-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-525941748" status: 202 len: 0 microversion: 2.1 time: 0.030365 Aug 01 22:59:34.350704 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 591/1162] 10.222.0.47 () {58 vars in 1260 bytes} [Mon Aug 1 22:59:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-525941748 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 23:01:42.806638 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 23:01:42.807412 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Mon Aug 1 23:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 23:01:59.890812 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 23:01:59.891494 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Mon Aug 1 23:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 23:02:03.837578 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 23:02:03.838429 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Mon Aug 1 23:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 23:02:53.895678 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 23:02:53.896567 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Mon Aug 1 23:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 23:03:21.868068 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 23:03:21.868771 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Mon Aug 1 23:03:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 23:05:02.816105 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 23:05:02.816723 dv-cinder-851640-1-iscsi devstack@n-api.service[124356]: Mon Aug 1 23:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 23:05:02.882924 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 23:05:02.883485 dv-cinder-851640-1-iscsi devstack@n-api.service[124358]: Mon Aug 1 23:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!